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support  a  requirement  for  a  wide-angle  visual  display  for  the  training  of 
circling  approaches  and  carrier  landings. 

Three  groups  of  Air  Force  T*38  instructor  pilots  were  given  simulator 
training  in  aircraft  carrier  landings.  These  pilots  ware  taught  to  execute 
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a  landing  on  a  simulated  aircraft  carrier  in  the  Advanced  Simulator  foi 
Pilot  Training  (ASPT)  at  Williams  Air  Force  Base.  The  visual  image  for  the 
simulation  was  provided  by  a  data  base  which  created  the  aircraft  carrier 
USS  Forrestal  (CVA-59)  in  the  ASPT  computer-image-generation  system.  The 
pilots  in  these  three  groups  were  trained  under  different  conditions.  Two 
groips  flew  a  circling  approach  with  one  group  using  a  wide  (300^ horizontal/ 
ISO'1  vertical).. visual  FOV  and  the  other  group  using  a  narrow  FOV  (48°, 
hor Lzontal/36°  vertical).  A  third  group  flew  a  straight-in  approach  using 
the  narrow  FOV.  A  variety  of  performance  measures  were  taken  to  characterize 
the  carrier  approach.  These  measures  were  categorized  as  (a)  instantaneous 
measures,  (b)  continuous  measures,  (c)  measures  representing  the  success  of 
the  approach  at  touchdown,  and  (d)  Landing  Signal  Officer  (LSO)  ratings. 
Various  statistical  routines  were  carried  out  with  the  results  obtained,  from 
these  measures.  < 

Results  indicate  that,  for  carrier  circling  approaches  and  lendings, 
there  are  no  clear  training  advantages  of  a  wide-angle  visual  display. 
Practice  on  straight-in  approaches,  using  a  narrow-angle  visual  display, 
appears  to  be  the  most  cost-effective  use  of  simulators  for  training  this 
task ; 
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SUMMARY 


Twenty-one  Air  Force  instructor  pilots  were  trained  to  mukr 
daytime  carrier  approaches  and  landings  using  the  Advanced  Simu¬ 
lator  Tor  Pilot  Training.  All  training  was  conducted  by  a 
qualified  Navy  Landing  Signal  Officer.  Training  was  accomplished 
under  one  of  three  conditions:  Group  WC  used  the  simulator's 
wide-angle  visual  display  (300  degrees  horizontal  by  150°  vertical) 
and  was  trained  on  circling  approaches  and  landings  that  began  at 
the  180°  downwind  position;  Group  NC  had  a  narrow-angle  visual' 
display  (48°  X  36°)  but  still  was  trained  on  the  circling  task; 
Group  NS  also  had  the  restricted  field  of  view  and  received 
training  exclusively  on  straight-in  approaches  and  landings.  All 
groups  received  the  same  amount  of  training  and  were  then  tested 
on  the  circling  approach  and  landing  task  with  the  full  visual 
display  (identical  to  the  WC  training  condition). 

Large  and  consistent  differences  were  seen  between  conditions 
during  training.  By  the  end  of  training  phase,  a  variety  of 
measures  showed  that  best  performance  was  associated  with  straight- 
in  training  (Group  NS)  while  circling  approaches  with  the  narrow- 
angle  display  (Group  NC)  resulted  in  the  lowest  scores.  However, 
when  all  groups  were  then  tested  under  the  WC  condition  no  signi¬ 
ficant  performance  differences  were  found. 

It  is  concluded  that  evidence  does  not  support  a  requirement 
for  a  wide  angle  visual  display  for  the  training  of  this  task. 
Providing  training  on  the  straight-in  portion  of  the  approach 
with  a  narrow  visual  display' produced  better  performance  during 
acquisition,  and  transfer  results  that  were  comparable  to  those 
of  the  other  traihing  conditions.  In  addition,  even  when  instruc¬ 
tion  was  provided  on  the  circling  part  cf  the  task,  the  wide  field 
of  view  produced  no  clear  training  advantages.  Practice  on 
straight-in  approaches,  using  a  narrow-angle  visual  display, 
appears  to  be  the  most  cost-effective  use  of  simulators  for 
training  carrier  circling  approaches  and  landings. 

In  view  of  the  implications  of  this  research  for  simulator' 
design,  it  is  advisable  to  determine  whether  the  principal  results 
will  replicate  under  conditions  of . considerably  greater  training 
time  and  with  less-skilled  pilots  as  subjects. 
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PREFACE 


The  Cooperative  Study  Series  was  created  for  reports  of 
cooperative  efforts  between  the  Naval  Training  Equipment 
Center  and  the  Air  Force  Human  Resources  Laboratory.  Those 
organizations  occasionally  have  pooled  their  resources  for 
research  on  flight  simulation  and  flying  training  techniques. 
Previous  reports  have  described  research  on  compensation  for 
simulation  delays  and  performance  measurement  for  simulations 
of  air-to-air  combat,  and  the  present  report  is  the  third  of  the 
series.  This  report  describes  the  results  of  a  study  of  the 
field  of  view  necessary  for  the  visual  displays  of  flight  train¬ 
ers  designed  for  the  training  of  circling  approaches  to  landing. 

In  this  particular  experiment  the  landing  was  on  an  aircraft 
carrier. 

Many  people  at  the  Operations  Training  Division  of  the  Air 
Force  Human  Resources  Laboratory  contributed  significantly  to 
this  research.  At  a  meeting  of  the  technical  advisory  group  for 
the  Navy's  Visual  Technology  Research  Simulator,  Mr.  Warren  E. 
Richeson,  chief  of  the  systems  engineering  branch,  suggested  that 
the  Advanced  Simulator  for  Pilot  Training  (ASPT)  would  be  ideal 
for  this  effort,  and  later,  Lt  Col  Samuel  T.  Hannan  and  Capt 
Ricky  A.  Perry  were  assigned  responsibility  for  coordination  of 
the  project.  They  recruited  instructor  pilots  to  act  as  subjects 
and  attended  to  innumerable  details  during  the  months  of  prepar¬ 
ation  prior  to  the  collection  of  data. 

During  this  period  of  preparation  Capt.  Edmund  Chun  and  Mrs. 
Michelle  Bliss  (of  Singer-Link)  attended  to  the  definition  of 
experimental  conditions  and  the  measurement  of  flying  perfor¬ 
mance.  Mr.  Jim  McHugh,  Mr.  Scott  Wall,  and  Mr.  Robert  Rife, 
all  of  Systems  Engineering  Laboratories,  performed  much  of  the 
work  necessary  to  define  the  image  of  the  aircraft  carrier  and 
develop  a  model  of  the  operation  of  the  Fresnel  Lens  Optical 
Landing  System.  Mr.  Donald  Bustell  of  Singer-Link  helped  to 
verify  their  adequacy,  and  Mr..  William  Brubaker  developed  the 
video  taped  materials  used  for  briefings. 

During  the  collection  of  data,  Mr.  Thomas  Farnan  acted  as 
operations  coordinator  and  Mr.  Donald  Fulton,  Mrs.  Pamela  Kpsirog, 
and  Mr.  Mark  Kilgore,  all  of  Singer-Link,  acted  as  operators  at 
the  advanced  instructor's  console  of  the  ASPT.  From  the  initial 
planning  of  the  experiment  through  the  report  preparation, 

Mr.  Robert  Woodruff  and  Dr.  Harold  Warner  (of  the  University  of 
Dayton),  provided  much  useful  support  and  advice. 
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Several  Navy  personnel  were  also  helpful.  As  usual,  Capt 
William  C.  Mercer,  the  Chief  of  Naval  Education  and  Training 
Liaison  Officer  at  Williams  Air  Force  Base  provided  encourage¬ 
ment,  attended  to  numerous  details,  and  was  a  great  help  to  the 
entire  effort  from  start  to  finish.  LCdr  Wayne  Kelly  and  Lt 
James  Brodengeyer  acted  as  liaisons  between  COMLATWING  ONE,  NAS 
Cecil  Field  and  the  Naval  Training  Equipment  Center.  They  were 
instrumental  in  providing  Lt  Anderson  so  that  an  operational 
Landing  Signal  Officer  could  conduct  the  training. 

Finally,  Hr.  Cavan  Lintern  of  Canyon  Research  Group  provided 
many  suggestions  concerning  -the  design  of.  the  stuay  and  the 
resulting  analysis  of  the  data. 

No  experiment  can  be  accomplished  without  subjects  willing 
to  perform  under  its  various  conditions,  and  we  would  like  to 
thank  the  volunteer  pilots  of  the  97th  Flying  Training  Squadron 
for  taking  the  time  to  participate:  Capt  Randolph  Albright, 

Capt  Steve  Allen,  Capt  David  Barker,  Lt  Charles  Glau'ser,  Lt 
Scott  Hammond,  Capt  Steven  Hardaway,  Lt  Julius  Hargrove,  Capt 
Dan  Hulsey,  Capt  Mark  Johnson,  Lt  Richard  Kleinhans,  Capt  R.B. 
Melhorn ,  Capt  Mario  Mellum,  Capt  Bruce  Myers,  Capt  David  Parker, 
Capt  Dennis  Pike,  Capt  George  Pinkston,  Capt  Kim  Ritchie,  Capt 
Gregory  Smith,  Lt  Jon  Turner,  Lt  Robert  Walden,  and  Capt 
Thomas  Watson. 
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SUCTION  I 
INTRODUCTION 


BACKGROUND 

Visual  simulation  technology  continues  to  be  a  critical 
issue  for  the  flight  training,  research  community.  The  perceptual 
requirements  that  simulators  must  satisfy,  and  the  visual  informa¬ 
tion  that  is  critical  for  optimum  pilot  training  are  still  very 
much  in  question.  With  the  continued  pressure  for  increased 
realism  in  visual  simulation,  and  with  the  increased  costs 
associated  with  this  realism,  the  potential  training  payoff  of 
visual  technology  improvements  must  be  clearly  understood. 

A  point  that  is  sometimes  overlooked  in  discussions  of 
simulation  fidelity  research  is  that  it  can  be  misleading  to 
investigate  simulator  variables  apart  from  training  variables. 
Rather,  the  nature  of  the  training  system  should  be  considered 
in  its  entirety.  Failure  to  look  at  training  techniques  and 
training  technology  together  may  be  the  result  of  regarding 
simulators  simply  as  substitutes  for  the  aircraft.  This  point 
of  view  easily  leads  to  the  idea  that  training  in  the  simulator 
should  be  accomplished  in  the  same  way  as  training  in  the  aircraft 
This  concept,  in  turn,  suggests  the  need  for  a  great  deal  of 
realism  (i.e.,  if  the  simulator  is  substituting  for  the  airplane, 
then  the  simulated  environment  should  substitute  for  the  real 
world).  In  fact,  when  simulator  training  is  almost  identical  to 
aircraft  training,  a  strong  case  can  be  made  for  high  realism. 

Some  researchers,  however,  are  suggesting  that  simulator- 
based  training  should  sometimes  be  conducted  in  a  very  different 
way  from  that  which  is  possible  in  the  airplane  (Hughes,  1979).  ' 
When  such  a  possibility  is  seriously  considered,  departures  from 
real  world  fidelity  in  the  visual  scene  may  seem  less  heretical. 

The  present  •  study  concerns  both  a  training  variable  and  a 
visual  fidelity  variable.  A  task  is  considered  which,  if  it  were 
taught  in  the  same  manner  as  it  is  taught  in  the  aircraft,  might 
require  a  costly  approach  to  visual  simulation.  The  following 
questions  are  being  asked.  How  effective  is  the  alternate  method 
af  training,  which  would  permit  the  use  of  a  less  costly  visual 
system?  How  effective  would  the  original  approach  to  training 
De  if  the  less  costly  visual  system  were  used? 

The  visual  fidelity  parameter  of  inrerest  in  this  study  is 
the  field  of  view  (FOV) ,  which  has  perhaps  the  greatest  cost 
implications  of  any  simulator  design  variable.  For  equivalent 
levels  of  resolution  and  scene  detail,  a  wide  angle  visual 
system  is  many  times  the  cost  of  a  typical  single-window  (approx- 
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imately.  48°  x  36°)  disnlay  system.  For  some  tasks,  such  as  air 
combat  training,  the  added  cost  can  be  easily  justified  by  the 
improved  training  capability  of  the  simulator.  For  some  other 
tasks,  the  value  of  having  a  wide  visual  coverage  should  be  care¬ 
fully  examined. 

FIELD  OF  VIEW  RESEARCH 

Considerable  research  into  the  effects  of  FOV  restriction 
on  pilot  performance  has  been  performed  over  the  years,  for  both 
fixed  and  rotary  wing  aircraft.  In  the  case  of  fixed-wing  aircraft 
there  has  been  a  number  of. in-flight  studies  demonstrating  rela¬ 
tively  little  loss  of  flying  skill,  even  when  the  FOV  is  consider¬ 
ably  less  than  that  provided  by  even  the  narrow  angle  visual 
systems  of  current  simulators.  Some  of  the  earliest  work  was  done 
by  Roscoe  (1948,  1951).  He  found  that  takeoffs  and  landings  could 
be  accomplished  safely  by  experienced  pilots  with  a  FOV  as  small 
as  10°  horizontal  x  10°  vertical,  although  increasing  the  FOV  did 
improve  precision.  Flight  trials  conducted  by  Armstrong  (197C). 
under  day  and  night  conditions  with  good  and  poor  visibility 
showed  virtually  no  decrement  of  landing  performance  when  ti.e 
horizontal  FOV  was  restricted  to  49°.  Reeder  and  Kolnick  (1964) 
found  both  takeoff  and  landing  performance  to  be  adequate  when 
pilots  looked  at  closed-circuit  TV  pictures  in  which  the  FOV  was 
21.5°  horizontal  and  vertical.  Perry,  Dana  and  Bacon  (1967) 
looked  at  180°  approaches  and  landings  in  a  T-33A  jet  and  found 
that,  even  with  a  FOV  as  small  as  5.7°  horizontal  x  3C°  vertical, 
touchdown  performance  was  not  degraded.  Interestingly,  pilots 
believed  that  even  slight  FOV  restrictions  were  detrimental  to 
their  performance.  This  point  raises  the  poss  bility  that  more 
sensitive  measures  of  performance  may  have  revealed  a  larger 
effect  in  some  of  these  studies.  Nevertheless,  the  fact  remains 
that  performance  remained  within  the  safe  and  acceptable  range 
even  with  substantial  FOV  restrictions.'  ' 

Simulator  studies  on  the  Air  Force  Advanced  Simulator  for 
Pilot  Training  (ASPT)  have  also  examined  the  FOV  variable  and 
have  measured  performance  more  precisely  than  is  usually  possible 
with  in-flight  studies.  Irish,  Grunzke,  Gray  and  Waters  (1977) 
looked  at  pilots'  ability  to  perform  five  maneuvers  in  the  ASPT 
under  combinations  of  six  independent  variables,  including  FOV.  ■ 
Only  one  maneuver,  an  aileron  roll,  was  performed  significantly 
better  with  a  wide  FOV  (300°  horizontal  x  150°  vertical)  as 
compared  to  a  48°  x  36°  window.  The  other  maneuvers  showed  minor 
improvement  favoring  the  wide  FOV.  A  later  study  (Irish  and 
Buckland,  1978)  again  looked  at  pilot  performance  for  the  same 
five  maneuvers  and  included  a  third,  intermediate  FOV  level 
(144°  horizontal  x  36°  vertical).  The  results  were  complex  and 
large  differences  were  seen  between  pilots,  but  in  general  the 
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larze  1  07  was  best  lor  the  aileron  roll,  the  barrel  ••oil  and  the 

overhead  pattern.  Measures  sensitive  to  roll  performance 
were  most  likely  to  reflect  FOV  differences. 

!he  studies  reviewed  to  this  point  have  concerned  tasks 
such  as  landing  and  basic  contact  maneuvers  which,  for  fixed 
wing  aircraft,  topically  require  the  pilot  to  look  more  or  loss 
straight  ahead.  Restricting  the  FOV  the:  results  primarily  in  a 
loss  of  peripheral  information,  and  this  loss  generally  has  only 
a  small  effect  on  performance.  A  task  requiring  pilots  to  use 
their  central,  rather  than  peripheral,  vision  over  a  large  area 
was  shown  to  be  muvh  more  sensitive  to  FOV  variations.  Woodruff, 
Longridge,  Irish  and  Jeffreys  (1979)  looked  at  aerial  refueling 
in  the  ASPT,  a  tank  that  required  the  pilot  to  attend  to  small 
size  and  shape  changes  in  the  tanker  aircraft.  The  authors 
found  FOV  to  be  an  important  variable  af feet  ing  performance  of 
this  task.  A  consistent  result  was  that  performance  was  best 
with  the  full  ASPT  FOV  (300°  hori7ontal  x  1S0°  vertical). 

Most  studies  that  have  looked  at  the  effects  of ,  restrict  ing 
central  (fd'veal)  vision  have  been  concerned  with  helicopter  or 
V/STOL  (Vertical/Short  Takeoff  and  Landing)  aircraft.  For  example, 
Stanelford,  Clement,  Meffley  and  Booth  ( J  9  7  9  >  looked  at  pilots’ 
ability  to  land  a  simulated  V/STOL  aircr  ft  on  a  destroyer. 

Although  FOV  was  not  a  variable,  numerous  pilot  comments  indicated 
that  the  48°  horizontal  x  36°  vertical  FOV  was  inadequate  for 
judging  fore-aft  position  and  velocity  over  the  deck,  and  for 
distinguishing  between  deck  motion  and  aircraft  motion.  NAVAIR- 
TF.S7C1.N  (  1978a)  describes  the  evaluation  of  the  SH-2F  (LAMPS  MK  I) 
Weapons  System  Trainer  in  which  .  inadequacies  ascribed  in  part  to 
a  limited  vertical  look-down  angle  have  •».:stricted  its  usefulness 
for  training  helicopter  shipboard  landin  Other  studies  con¬ 
cerned  with  FOV  issues  for  helicopter  flight  (Yeend  and  Carico, 

1  978  ;  NAVA  1  RTESTCF.N .  '978b;  Frezell,  Hofmann  and  Oliver  1973) 
have  also  indicate  the  desirability  of  a  relatively  large  FOV, 
particularly  f  heier  and  la. ding  tasks.  Thus,  although  there 
is  a  scaicit>  A  controlled  objective  experiments  looking  at  FOV 
requirements  for  helicopter  and  V/STOL  aircraft,  there  is 
considerable  support  (based  on  pilot  opinions)  for  the  assertion 
that  a  relatively  large  FOV  is  desirable  when  operating  these 
aircraft  at  slow  speeds  and  close  to  obstructions.  In  these 
situations,  the  pilot  must  use  his  central  vision,  scanning  the 
environment  to  check  for  obstructions  and  to  judge  his  distance 
to  nearby  objects. 

All  studies  discussed  so  far  have  dealt  with  how  FOV  affects 
pilots'  ability  to  fly,  and  not  how  well  they  can  learn  to  fly. 
However,  a  recent  study  by  Nataupsky,  ".'aag,  Weyer,  McFadden  and 
McDowell  (1979)  did  examine  the  effects  of  restrictions  to  the 
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FOV  or  transfer  of  training.  The  variables  in  this  experiment , 
conducted  on  the  AS PI,  were  platform  motion  (6  degrees  of  freedom 
versus  no  motion )  and  FOV  (300°  x  130°  /crsas  48°  x'  3cc' ).  Students 
were  trained  on  four  tasks:  takeoff,  steep  turn,  slow  flight, 
and  straight -in  approach  and  landing.  Following  training  in  the 
simulator,  they  were  tested  during  their  first  sortie  in'  the  1-37 
aircraft.  The  results  for  the  in-simulatcr  training  phase  showed 
some  motion  effects,  and  two  significant  main  effect:  for  FOV 
(for  two  tasks,  elevator  control  movement  was  greater  in  the 
narrow  FOV  condition!.  Subsequent  performance  in  the  a’rcraft 
revealed  no  significant  FOV  effects.  Thus  there  is  no  evidence 
to  suggest  that  training  with  a  wide  FOV  improved  transfer  c  f  ■ 
training  to  the  aircraft  for  the  four  basic  contact  maneuvers 
stud ' ed  . 

CARR  I KR  LANDING  TRAINING 

This  experiment  concerns  training  a  typical  Navy  daytime 
carrier  approach  and  landing,  starting  from  the  ISO1'  downwind 
position.  The  task,  described  in  detail  in  the  next  section, 
involves  two  main  components:  (a)  a  left-hand  descending  turn 
that  begins  opposite  the  stern  of  the  carrier  and  continues  until 
the  aircraft  rolls  out  on  the  final  approach,  approximately  3/4 
mile  from  the  ship  and  (b)  a  final  straight-in  descent  termina¬ 
ting  with  an  arrested  landing.  Pilots  t>pically  fly  the  turn 
using  instruments  predominantly,  supported  by  occasional  glances 
at  the  ship  in  order  to  judge  the  progress  of  the  turn  and  to 
ensure  that  the  roll-out  is  completed  when  the  aircraft  is  in 
line  with  the  landing  deck.  . 

One  question  being  asked  in  this  experiment  was  the  following. 
If  r.  simulator  is  being  used  to  help  train  this  task  should  avail¬ 
able  simulator  flight  time  he.  concent ra ted  on  the  final  straight- 
i'n  portion  of  the  task,  or  should  considerable  practice  also  be 
given  on  the  turn?  The  argument  for  training  only  on  the  straight- 
in  approach  notes  that  this  portion  of  the  task  is  the  most  de¬ 
manding,  and  requires  the  most  practice  in  order  to  learn  the 
techniques  of  a  precise,  controlled,  on-speed  descent.  Training 
on  the  turn  is  less  important,  particularly  since  pilots  have 
already  become  proficient  at  making  turns  before  carrier  train¬ 
ing  begins.  The  other  viewpoint,  however,  stresses  the  importance 
of  being  in  precisely  the  correct  position  when  the  straight-in 
approach  begins,  and  suggests  that  the  final  approach  should  he 
considered  as  starting  at  the  180°  position.  If  pilots  cannot 
complete  the  turn  with  precision,  their  chances  of  landing 
successfully  are  greatly  reduced;  therefore,  simulator  practice 
on  this  portion  of  the  task  should  not  be  neglected. 
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While-  the  above  issue  is  of  interest  to  those  who  design 
training  programs,  it  is  actually  of  greater  importance  to  those 
who  specify  the  requirements  for  flight  simulators,  as  well  as 
to  those  who  allocate  funds  for  their  purchase.  This  is  because 
of  the  implications  for  the  simulator  FOV.  If  practice  in  the 
simulator  is  restricted  to  straight-in  approaches,  the  evidence 
suggests  that  a  relatively  narrow  FOV  should  suffice,  since  only 
peripheral  information  is  being  removed .  If,  however,  it  is 
better  to  begin  training  at  the  180°  position,  a  narrow  FOV 
may  be  a  serious  detriment  to  training.  Since  the  carrier  would 
not  be  in  view  during  the  turn,  important  centrally-acquired 
(foveal)  information  has  been  removed  tl at  could  affect  the 
student's  ability  to  learp  the  task. 

STUDY  OBJECTIVE 

To  summarize,  the  objective  of  this  study  was  to  investigate 
simulator  FOV  requirements  in  conjunction  with  two  methods  for 
training  the  daytime  carrier  circling  approach  and  landing  task. 
This  was  accomplished  by  training  some  pilots  on  circling  ap¬ 
proaches  with  either  a  wide  or  narrow  FOV  and  training  others 
on  straight -in  approaches  with  a  narrow  FOV.  All  were  then 
tested  on  the  circling  task  with  the  wide  FOV. 
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METHOD 


SUBJECTS 

The  21  volunteers  who  served  as  subjects  in  this  experiment 
were  Air  Force  instructor  pilots  from  the  97t'h  Flying  Training 
Squadron  located  at  Williams  Air  Force  Bass,  Arizona.  All  were 
instructors  for  advanced  jet  training  in  the  T-38  aircraft.  As  a 
group,  they  had  accumulated  between  70S  and  14S0  individual  hours 
of  flying  with  a  group  average  of  1038  hours. 

EQUIPMENT 

This  study  used  the  Advanced  Similator  for  Pilot  Training 
(ASPT)  ,  a  research  device  located  at  Williams  Air  force  Base.. 
Numerous  papers  have  described  this  facility;  a  good  overview  is 
given  by  Gum,  Albery,  and  Basinger  (1975).  Each  of  two  simulator 
cockpits  is  surrounded  by  a  mosaic  of  seven  pentagon-shaped  CRT 
channels  to  display  a  300°  horizontal  x  150°  vertical  field  of 
view  with  the  optics  to  present  computer-generated  visual  scenes 
as  virtual  images.  Each  cockpit  is  mounted  on  a  motion  platform 
and  each  is  equipped  with  a  G-seat.  An  instructor's  console 
contains  repeater  instruments  as  well  as  CRT  displays  to  indicate 
the  state  of  the  simulated  aircraft  along  with  TV  monitors  for 
the  CIG  channels.  The  console  clso  contains  keyboards  and 
switches  to  determine  conditions  of  the  experiment  and  to  initiate 
individual  trials.  Data  collected  during  trials  can  be  stored 
until  the  end  of  a  testing  session  and  then  recorded  on  a  variety 
of  permanent  media.  At  the  time  of  this  study,  the  cockpits  and 
instructor's  console  were  controlled  by  two  Systems  Engineering 
Laboratories  model  86  computers. 

The  configuration  of  the  ASPT  cockpits  can  be  changed,  and 
for' this  study  the  "B"  cockpit  was  configured  as  an  A-10.  This  is 
a  single-seat  attack  aircraft  similar  to  those  used  for  carrier 
operations.  allow  the  subjects  to  fly  a  constant  angle-of- 

attack  (AOA)  approach,  an  AOA  indexer  was  installed  in  the 
appropriate  position  in  the  A-10  cockpit,  and  a  repeater  indexer 
was  mounted  on  the  instructor's  console.  Because  the  interest  of 
this  study  was  the  field  of  view  needed  to  train  carrier  approaches, 
neither  the  motion  platform  nor  the  G-se/t  was  active;.  Several  ■ 
graphics  displays  and  TV  monitors  were  available  on  the  consol^, 
and  one  of  these  was  used  to  display  the  CIG  channel  directly 
in  front  of  the  pilot.  A  graphics  tube  also  was  used  for  a 
Carrier  Controlled  Approach  (CCA)  type  of  landing  u.cplay.  The 
Landing  Signal  Officer  (LSO)  who  conducted  training  fre.:  the 
console  had  the  pilot's  straight-ahead  visual  scene,  the  AOA 
indexer,  and  other  indicators  (such  as  for  power  setting,  air¬ 
craft  altitude  and  airspeed)  located  in  a  restricted  area  which 
he  could  monitor. 


Figure  1.  Carrier  Glidcslope  Geometry 
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TASK  AND  EX  PER I MENTAL  CONDITIONS 

The  experimental  tasks  were  simplifications  of  day  and  night 
carrier  approaches.  During  the  day,  aircraft  are  normally  re¬ 
covered  by  having  them  fly  abeam  of  the  starboard  side  of  a 
carrier  in  the  direction  of  the  ship's  heading.  A  specified  time 
after  passing  the  ship,  the  pilot  executes  a  180°  turn  to  the 
left  and  flys  back  past  the  approaching  carrier  about  1  to  1.5 
miles  to  its  left.  When  the  aircraft  passes  the  carrier's  ramp 
(the  aft  end  of  the  landing  deck),  a  190.5°  turn  to  the  left  is 
performed  so  that,  when  the  pilot  rolls  out,  the  aircraft  is  in 
line  with  the  center  marking  of  the  recovery  deck'.  At  night 
the  aircraft  arrives  in  a  marshalling  area  about  10  miles  aft  of 
the  ship  and  then  flies  a  straight-in  approach. 

Final  approach  descent  is  guided  by  the  Fresnel  Lens  Optical 
Landing  System  ,  (FLOLS)  which  displays  a  vertically  moveable 
center  light  heam  (the  "meatball”)  which  must  be  kept  aligned 
with  rows  of  stationary  horizontal  lights.  When  the  aircraft  is 
above  or  below  the  correct  glideslope,  the  meatball  is  seen  as 
above  or  below  the  horizontal  reference  lights.  If  the  pilot 
is  viewing  a  centered  meatball,  and  if  the  aircraft  has  the 
correct  AOA,  the  tailhook  will  be  in  the  proper  position  to  catch 
one  of  the  arresting  wires  on  the  deck.  These  relations  are 
depicted  in  Figure  1.  For  this  experiment  the  desired  glide- 
slope  was  3.5°. 

The  FLOLS  beam  is  about  45°  wide  so  that  when  the  aircraft 
is  about  four-fifths  through  the  turn,  the  meatball' can  be  seen 
and  glideslope  adjustments  can  be  started.  Except  for  occasional 
glances  to  locate  the  aircraft  carrier,  the  circling  approach  is 
made  on  instruments  until  the  meatball  is  sighted.  Then  pilot 
actions  should  be.  determined  by  two  sources  of  visual  cues: 

(a)  information  on  glideslope  and  lineup  presented  by  the  FLOLS 
and  markings  on  the  carrier  deck,  respectively;  and  (b)  AOA 
informat  ion,  by  the  indexer  inside  the  cockpit.  For  either  day  or 
night  approaches,  pilots  make  a  constant  airspeed  approach  by 
manipulation  of  the  throttle  and  stick  while  lineup  is  maintained 
by  control  of  the  stick  and  rudder.  Since  the- optimum  AOA  is 
maintained  until  touchdown,  the  aircraft  is  not  flared  at  landing 

The  visual  irtiagc  for  the  simulation  of  this  task  was  pro¬ 
vided  by  a  data  base  for  the  aircraft  carrier  USS  Forrestal  (CVA- 
59)  for  display  by  the  ASPT  Computer  Image  Generation  (CIG) 
system.  This  system  has  the  capability  for  one  moving  model 
which  was  devoted  to  the  FLOLS  display.  The  result  was  that  the 
carrier  was  stationary  against  a  sea/sky  horizon,  and  to  compen¬ 
sate  for  this,  30  knots  of  wind  was  created  from  a  heading  of  . 
349.5°  (down  the  flight  deck).  To  allow  movement  of,  the  meatball 
+  2  ball-widths  plus  a  centered  position  were  divided  into  15 
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positions.  Each  "ball"  unit  thus  had  3  positions  allotted  to 
it,  so  that  ball  movement  would  be  fairly  smooth.  As  the  ASPT 
CIG  system  is  a  monochrome  display,  the  3  lowest  positions  were 
flashed  to  represent  the  change  to  a  flashing  red  ball  at  2-balls 
low.  V.'aveoff  lights  were  also  flashed  when  the  LSO  decided  the 
aircraft  was  not  in  a  position  to  land  safely. 

Because  of  limits  on  the  resolution  available  with  the  ASPT 
CIG  system,  the  size  of  the  FLOLS  display  was  enlarged  when  at  a 
range  greater  than  3/4  mile.  At  the  3/4  mile  point,  this  size 
was  reduced  and  the  display  moved  in  closer  to  the  ship;  at  the  , 
1/4  mile  point,  the  FLOLS  was  its  normal  size  and  in  its  normal 
location.  A  last  point  should  be  noted  about  the  carrier  image. 

To  enable  pilots  to  exit  the  final  turn  lined  up  with  the  center 
line,  the  carrier's  wake  was  made  to  disperse  at  an  angle  of  21°. 
The  right  edge  of  the  wake  was  then  parallel  to  the  flight  deck 
and  a  little  to  the  right  of  the  centerline.  These  features  can 
be  seen  in  Figure  2,  which  is  a  photograph  taken  when  the  simu¬ 
lated  aircraft  was  approximately  1/4  mile  from  the  carrier. 

Two  starting  positions  and  two  FOVs  were  used  to  create  the 
three  conditions  for  training.  A  circling  approach  was  started 
at  the  point  marked  C  in  Figure  3.  This  point  was  1000  feet 
ahead  of  the  carrier,  1.15  miles  abeam.  The  aircraft  was  started 
at  an  altitude  of  600  feet  and  an  airspeed  of  120  knots.  Straight 
in  approaches  started  with  the  aircraft  at  point  S  in  Figure 
3.  So  that  pilots  learning  under  this  condition  would  have  to 
manipulate  the  controls  to  become  lined  up,  point  S  was  displaced 
to  the  left  of  a  heading  straight  down  the  carrier  deck.  This 
point,  chosen  so  that  the  circling  and  straight-in  approaches 
involved  the  same  flight  time-  (about  130  seconds),  was  2.3  miles 
behind  the  carrier  and  1.1  miles  to  the  left  of  centerline. 

Two  fields  of  view  were  used.  A  wide  FOV  condition  repre¬ 
sented  the  limits  available  on  the  ASPT  (300°  horizontal  x  150° 
vertical),  while  a  narrow  FOV  was  set  to  the  48°  horizontal  x 
36°  vertical  dimensions  that  are  characteristic  of  many  training 
simulators.  Because  the  carrier  was  lower  than  the  aircraft  and 
the  approaches  were  flown  with  a  high  AOA,  this  window  was  posi¬ 
tioned  to  be  6°  above  the  horizon  and  30°  below  it.  This  location 
permitted  more  of  the  carrier  and  its  wake  to  be  displayed. 

All  training  in  this  experiment  was  conducted  by  an  opera¬ 
tionally  qualified  Landing  Signal  Officer  (LSO).  LSOs  are  Naval 
aviators  whose  duties  include  communicating  with  pilots  on  every 
carrier  approach  that  is  made,  id  order  to  ensure  a  safe  approach. 
They  arc  also  responsible  for  conducting  all  carrier  qualification 
training.  At  the  time  of  the  study  the  LSO  was  assigned  to  a 
Readiness  Training  Squadron  (VA-174)  at  NAS  Cecil  Field,  Florida. 
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DESIGN 

This  study  was  designed  as  a  transfer  experiment  where  both 
the  acquisition  and  transfer  phases  occur  in  the  same  device. 

This  "quasi"  transfer  design  evaluates  acquisition  under  various 
conditions  by  testing  with  the  same  device  used  for  training. 

The  two  FOVs  and  two  approaches  previously  described  were  com¬ 
bined  to  form  three  conditions  for  acquisition,  as  shown  in  Table 
1.  A  wide  FOV,  circling  approach  (WC)  condition  was  used  to 


TABLE  1.  SUMMARY  OF  EXPERIMENTAL  CONDITIONS 


TRAIN 

TEST 

Group 

FOV 

Approach 

FOV 

Approach 

WC 

Wide 

Circling 

Wide 

Circling 

NC 

Narrow 

Circling 

Wide 

'  Circling 

NS 

Narrow 

Straight 

Wide 

Circling 

represent  carrier  approach  training  that  could  be  accomplished 
with  a  device  equipped  with  a  wide-angle  visual  display.  A 
narrow  FOV,  circling  approach  (NC)  condition  represented  training 
in  which  current  narrow  angle  displays  could  be  used  to  teach  the 
last  turn  as  well  as  final  approach  phases  of  aircraft  recovery, 
and  a  narrow  FOV,  straight-in  approach  (NS)  condition  represented 
training  as  currently  conducted  with  narrow-angle  CIG  visual 
displays.  Acquisition  under  these  conditions  was  assessed  by 
using  a  transfer  condition  that  represented  the  highest  fidelity 
available  on  the  ASPT  -  a  wide  FOV  and  a  circling  approach  (the 
WC  condition)  . 

Six  T-37  instructor  pilots  assigned  to  the  Air  Force  Human 
Resources  Laboratory  (AFHRL)  served  in  some  preliminary  tests  to 
determine  the  rates  of  acquisition  under  these  conditions.  On 
the  basis  of  those  tests,  we  decided  to  allow  15  acquisition 
trials  per  condition  followed  by  15  trials  on  the  WC  transfer 
condition. 
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PERFORMANCE  MEASUREMENT 

A  variety  of  measures  was  taken  to  characterize  the  carrier 
approach.  Some  of  these  we  believed  would  be  sensitive  to  the 
conditions  of  acquisition  which  were  investigated  and  Some  were 
used  to  create  a  framework  for  further  experiments  on  carrier 
landing.  The  measures  fall  into  four  categories.  First  are 
instantaneous  measures  taken  at  specific  points  along  the  turn 
and  final  approach.  Starting  when  the  aircraft  passed  the  180° 
radial,  the  AOA,  altitude,  X  and  Y  position,  and  bank  angle  were 
recorded  every  22.5°  until  the  aircraft  passed  the  90°  radial. 
Then,  when  the  aircraft  was  past  the  90°  radial  anc.  was  less  than 
one  mile  from  the  ramp,  glidepath  deviation,  centerline  devia¬ 
tion,  and  AOA  were  sampled  every  1/4  mile  until  the  aircraft 
passed  the  ramp.  For  the  straight-in  approaches,  this  measure¬ 
ment  started  as  the  aircraft  passed  the  one-mile  position  and 
then  proceeded  normally. 

Second,  continuous  measures  were  also  recorded.  Two  sets  of 
these  were  taken  and  both  were  sampled  at  15  per  second.  The 
first  of  these  sets  represented  a  variety  of  pilot  control  inputs 
to  the  aircraft  that  were  measured  over  1/4-mile  Segments  start¬ 
ing  at  the  one-mile  marker  and  ending  at  the  ramp.  A  second  set 
of  continuous  measures  was  taken  over  the  flight  from  the  1/2- 
mile  point  to  the  ramp.  These  were  the  mean  and  rms  deviation; 
the  percent  of  the  time  a  parameter  was  in  a  high,  correct,  or 
low  category;  and  the  maximum  and  minimum  deviations  of  glide- 
slope  error,  centerline  deviation,  and  AOA.  The  criteria  used  to 
determine  in  which  category  (high,  on,  or  low)  a  given  observa¬ 
tion  occurred  are  presented  in  Table  2.  As  all  of  the  approaches 
were  close  to  the  glideslope  by  the  1/2  mile  marker,  these  repre¬ 
sented  system  measures  of  the  accuracy  of  control  for  the  various 
conditions. 

TABLE  2.  TOLERANCES  FOR  T IME-WITHIN-TOLERANCE  MEASURES.  , 


Clideslope 

Lineup 

Angle  of  Attack 

High 

>+1.0  ball  (>3.875°) 

>+1.5°  (right  of 

centerline) 

>22  units 

On 

±1.0  ball  (3.5+0.375°) 

±  1.5°  (centerline) 

20-22  units 

Low  . 

<-1.0  ball  (<3 . 125°) 

<-1.5°  (left  of 

centerline) 

<20  units 
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Third,  several  measures  were  taken  which  represent  final 
states  of  the  aircraft  and  the  success  of  the  approach  at  touch¬ 
down.  At  the  ramp,  the  centerline  deviation  and  the  hook-to-deck 
distance  were  measured;  measures  at  touchdown  included  the  bank 
angle,  pitch  angle,  the  vertical  velocity,  and  the  wire  caught. 

If  no  wire  was  caught,  the  flight  was  classified  as  a  bolter 
(touchdown  beyond  wires)  ,  ramp  strike  (impact  with  aft  end  of 
landing  deck),  or  waveoff. 

Fourth,  two  ratings  were  made  on  each  approach.  One  of 
these  was  made  by  the  LSO  using  an  expanded  scale  of  LSO  ratings. 
This  scale  translated  the  "cut",  "waveoff",  "no  grade",  "fair", 
and  "OK"  judgments  onto  a  0-12  scale  as  shown  on  Table  3.  The 
other  rating  was  the  landing  performance  score  (LSP)  developed  by 
Brictson,  Burger  and  Wulfeck  (1973).  The  LPS  scale,  ranging  from 
1-6,  assigns  scores  to  waveoffs,  bolters,  and  traps.  This  scale 
is  described  in  Table  4. 


TABLE  3. 

NORMAL  LSO 

GRADING  CRITERIA  IN 

RELATION  TO 

THE  EXPANDED  SCALE  USED  IN  THIS 

EXPERIMENT 

Modified 

Normal 

Common 

Scale 

Scale 

Terminology 

Description 

.  12 

---  A 

iinvn 

Minor  deviations 

A  1 

10 

— ►  and  above  average 

corrections 

9 

M  T?  „  -I  Mtl 

Average  deviations 

7 

J 

— ►  and  corrections 

6 

— ' ""  2 

H m ^  r* -w. ~  j  ^ii 

Major  deviations 

«/  ' 

A 

— ►  and  below  average 

4 

• 

corrections 

3 

2 

. .  1 

rtTiT „ , r _  rrii 

,  Not  in  position 

Lt  ^ 

1 

—►to  land  safely 

. .  1  u 

"Cut”  — — — 

(rarely  given) 
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TABLE  4.  LPS  ASSIGNED  TO  VARIOUS  LANDING 

OUTCOMES  (ADAPTED  FROM  BRICTSON,  ET  AL., 
1973)  . 

Landing  Performance 


Landing  Outqome  Score  (LPS) 

Waveoff  1.0 

#1  Wire  3.5 

#  2  Wire  5.0 

# 3  Wire  6.0 

U  Wire  4.5 

Bolter  (touchdown  beyond  wires)  2.0 

Ramp  Strike  (impact  with  ship)  0a 


a  Not  part  of  original  scale  developed  by  Brictson  et  al. 


PROCEDURE 

A  considerable  amount  of  development  work  was  necessary  for 
this  experiment.  A  data  base  for  the  image  of  the  USS  Forrestal 
(CVA-59)  for  the  CIG  system  of  the  ASPT  existed  but  had  to  be 
adjusted  for  the  correct  geometry  for  an  A-10  making  a  carrier 
approach.  Most  of  these  changes  reflect  simulation  of  the  FLOLS 
which  has  been  discussed  by  Golovcsenko  (1976).  Also,  several 
options  were  open  for  the  design  of  the  experiment  and  preliminary 
data  had  to  be  collected  for  these  various  decisions.  The  LSO 
decided  that  the  duration  of  his  briefing  could  be  reduced  if 
sections  of  Navy  training  films  were  used;  consequently  two 
films  (one  on  carrier  landing  and  one  on  the  operation' of  the 
FLOLS)  were  edited  to  make  a  short  video  tape  for  using  during  his 
briefing. 

The  T-38  instructor  pilots  were  not  familiar  with  the  ASPT, 
so  to  acquaint  them  with  control  of  that  device  two  sets  of 
initial  conditions  for  familiarization  flights  \  ■?  created.  In 

an  initial  instrument  flight  the  pilot  started  a.  an  altitude  of 
2000  feet,  and  then  executed  a  30°  angle-of-bank  turn  to  the 
right  until  a  change  of  heading  of  60°  was  made.  Then  he  returned 
to  the  original  heading,  still  holding  the  optimum  AOA.  He 
then  descended  at  500  fpm  to  1000  feet  and  leveled  the  craft 
for  10  seconds.  Last,  a  left  turn  at  30°  of  bank  was  performed. 

All  this  took  about  51/2  minutes  and  was  designed  to  provide 


23 
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practice  on  aircraft  control  while  holding  AOA  constant.  A 
second  set  of  flights  was  created  to  illustrate  acceptable 
carrier  approach  performance  for  each  of  the  three  experimental 
conditions.  These  were  flown  by  the  LSO,  recorded,  and  later 
used  as  dcmonstrat ion  rides  before  the  first  attempt  by  each 
subject  to  perform  the  task. 

Subjects  were  assigned  to  the  conditions  of  acquisition  on 
the  basis  of  total  flight  hours  and  hours  of  T-38  flight.  During 
the  course  of  the  data  collection,  some  changes  to  these  assign¬ 
ments  had  to  be  made,  but  these  did  not  alter  the  composition  of 
the  groups.  The  results  of  the  matching,  as  well  as  the  flight 
hours  and  number  of  landings  within  the  30  days  previous  to  the 
experiment,  are  presented  in  Table  5.  None  of  these  measures 
indicates  differences  between  the  groups. 

TABLE  5.  FLIGHT  EXPERIENCE  OF  PILOTS  IN 
THE  THREE  TRAINING  GROUPS. 


Group 


Measure 

WC 

Mean 

S.D. 

NC 

Mean 

S.D. 

NS 

Mean 

S.D. 

Overall 

Total  fit. 
hrs . 

1013 

211 

1052 

178 

1049 

254  ■ 

T-38  hours 

799 

216 

923 

160 

916 

200 

Prev.  30  Days 

Total  hours 

25 

16.5 

25 

10.6 

26 

7.9 

No.  landings1 

13 

9.5 

27 

20.1 

20 

12.9 

Three  3-hour  testing  sessions  were  scheduled  each  day  wi  h  a 
different  pilot  assigned  to  each.  This  time  allowed  for  a  brief¬ 
ing*  an  acquisition  period,  and  a  transfer  or  testing  period. 

The  pilot  was  first  presented  the  video-taped  material  on  carrier 
operations,  and  then  received  two  briefings.  The  first  of  these 
was  a  mandatory  safety  briefing  on  the  operation  of  the  cab  ane 
fire  control  equipment  on  the  ASPT.  The  second  was  a  description 
by  the  LSO  of  the  carrier  approach  task  and  the  techniques  of 
control  for  flying  a  constant  AOA  descent,  followed  by  a  descrip¬ 
tion  of  the  operations  of  the  FLOLS.  Pilots  were  reminded  that 
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snail  changes  of  pitch  and,  power  were  used  to  remain  on  the 
glideslope,  and  that  the  primary  cues  for  glideslope  and  lineup 
control  were  the  FL0L5  and  deck  markings.  The  LSO  also  provided 
nominal  values  for  aircraft  parameters  at  various  positions  about 
the  turn.  For  instance,  they  were  told  to  be  at  an  altitude  of 
b'00  feet  at  ISO0  ,  450  feet  at  90°,  and  375  feet  at  lineup,  and 
to  hold  approximately  21°  angle  of  bank  and  21  units  AOA  during 
the  turn.  LSO  calls  were  explained  so  that  the' pilot  knew  that 
some  calls  about  power  settings,  aircraft  altitude,  and  waveoff 
were  mandatory  and  required  a  response  and  that  other  calls  such 
as  ’’you're  high"  or  "check  line-up"  were  informative.  Pilots 
were  also  reminded  not  to  flare  and  to  go  to  military  power  at 
touchdown.  The  general  purpose  of  the  experiment  was  then 
briefly  described  to  them. 

After  a  pilot  was  seated  in  the  A-10  cockpit,  he  first  flew 
the  f ami  1 iar i cat icn  flights  previously  described.  He  then  viewed 
the  demonstration  flight  appropriate  to  his  particular  acquisi¬ 
tion  condition.  At  this  point  a  block  of  15  trials  was  started. 
These  trials,  including  the  130-second  flight  time,  took  about 
3-4  minutes  each  so  that  the  entire  data  collection  for  each 
pilot,  including  his  briefing,  took  about  2.5  hours.  After  the 
15  acuuisition  trials,  each  pilot  was  given  a  10-15  minute  rest 
outside  of  the  cockpit,  and  then  returned  for  the  WC  demonstra¬ 
tion  flight  and  15  transfer  trials.  At  the  end  of  testing,  the 
pilots  vere  briefed  about  their  performance. 

During  each  trial,  the  LSO,'  seated  at  the  instructor's 
console,  provided  mandatory  and  informative  calls  to  the  pilots. 
After  each  trial  he  briefed  the  pilots  concerning  their  approach 
performance,  and  provided  additional  instruction  as  required,. 

All  the  recorded  measures  were  stored  in  a  data  file  in  core 
until  the  end  of  a  day's  testing.  They  were  then  transferred  to 
a  disk  memory  and  a  hard  copy  was  made.  When  the  experiment  was, 
f ini  shed ,  these  data  were  copied  to  magnetic  tape  and  returned  to 
the  Navai  Training  equipment  Center  for  analysis. 
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section  hi 
RESULTS 


Results  are  presented  separately  for  three  major  segments  of 
the  task:  touchdown,  final  approach,  and  the  turn  beginning  from 
the  downwind,  abeam  position. 

TOUCHDOWN  PERFORMANCE 

The  EPS 

Touchdown  scores  are  summarized  in  terms  of  the  Landing 
Performance  Score  (EPS)  developed  by  Brictson  et  al.  (1$73).  This 
measure,  which  basically  reflects  longitudinal  touchdown  position, 
was  developed  as  a  read i ly - obt ainab 1 e  summary  measure  of  carrier 
landing  performance.  It  has  been  found  to  be  sensitive  to  different 
types  of  aircraft  and  to  day  versus  night  approaches  in  a  large  number 
of  fleet  landings,  and  correlates  well  with  LSO  ratings  of  final 
approaches  and  landings  (Brictson  et  al.,  1973).  Table  4  presents 
the  LPS  assigned  to  various  possible  outcomes. 

Figure  4  presents  the  LPS  data  for  the  three  groups,  for 
both  the  training  and  the  test  trials.  To  improve  the  clarity  of 
visual  presentation,  scores  are  averaged  over  three  successive 
trials . 

Analyses  of  variance  (ANOVAs)  were  performed  separately  for 
the  training  and  the  test  phases.  (Appendix  A  contains  summary 
ANOVA  tables  for  measures  discussed  in  this  section).  In  the 
training  phase,  there  was  a  significant  difference  between 
training  conditions  (pc.OS)  and  a  significant  effect  of  trials 
(p<. 005).  During  the  test  phase,  however,  when  all  groups 
performed  the  circling  task  with  ,  the  wide  FOV,  there  were  no 
significant  effects. 

Thus,  for  this  measure  of  touchdown  performance,  all  groups 
showed  substantial  improvement  across  the  15  training  trials. 
Furthermore ,  performance  was  clearly  superior  for  the  group  that 
flew  straight- in  approaches  (Group  NS),  and  was  poorest  for  the 
students  flying  circling  approaches  with  the  narrow  FOV  (Group 
NC) .  Across  the  IS  test  trials  no  further  learning  was  reflected 
by  this  measure,  and  there  was  no  evidence  that  the  training, 
conditions  had  any  differential  effect  on  subsequent  transfer 
performance. 

Table  6  summarizes  the, landing  results  in  terms  of  the  four 
categories  of  outcome : ,  traps  (successful  wire  catches),  wave- 
offs,  bolters  (touchdowns  beyond  the  wires) ,  and  ramp  strikes 
(impacts  with  the  stern  of  the  ship).  It  may, be  seen  that  the 
most  probable  outcome  of  a  training  trial  was  a  waveoff,  and  that 
the  overall  boarding  rate  (percentage  of  traps)  during  training 
was  28",  and  during  testing  was  471. 
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TABLE  6.  PERCENTAGES  OF  LANDING  OUTCOMES 
IN  EACH  OF  FOUR  CATEGORIES 


Group 

Outcome 

Training 
Trials  1-15 

Testing 
Trials  16-30 

WC 

Traps 

26 

48 

Waveof fs 

41 

7 

Bolters 

26 

32 

Ramp  Strikes 

7 

13 

NC 

Traps 

21 

43 

’.Vaveoffs 

50 

22 

Bolters 

16 

26 

Ramp  Strikes 

13 

9 

NS 

Traps 

38 

51 

Waveoffs  . 

23 

14 

Bolters 

29 

14 

Ramp  Strikes 

10 

21 

TOTALS 

Traps 

28 

47 

Waveof  fs 

38 

14 

Bolters 

24 

27 

Ramp  Strikes 

10 

12 

FINAL  APPROACH  PERFORMANCE 
LSO  Grades 

Each  pass  was  evaluated  by  the  LSO  and  assigned  a  numerical 
grade  on  a  scale  which  was  essentially  a  3  for  1  expansion  of  the 
scale  normally  used  by  LSOs  to  grade  every  carrier  approach, 
during  both  training  and  fleet  operations.  Because  it  was  anti¬ 
cipated  that  most  passes  would  be  on  the  lower  half  of  the  scale, 
expansion  of  the  scale  was  considered  worthwhile  to  permit  finer 
distinctions.  Table  3  provided  a  comparison  between  the  scale 
used  here  and  the  one  normally  used.  It  may  be  seen  from  the 
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descriptions  of  the  meaning  of  the  numbers  that  LSO  scores 
are  subjective  and  based  on  each  LSO's  experiences  and 
extensive  training  over  the  years.  The  LSO  in  this  experiment 
did  his  best  to  maintain  a  consistent  standard  across  the  entire 
study,  and  to  apply  the  same  criteria  that  he  would  use  in 
evaluating  fleet  pilots.  Thus,  if  a  pass  was  judged  "average",  it 
was  average  with  respect  to  an  experienced  Naval  aviator. 

The  LSO  grades  are  shown  in  Figure  S.  It  can  be  seen  that 
the  results  are  similar  to  those  obtained  for  the  LPS.  There  is 
a  clear  separation  between  the  groups  during  training,  with  Group 
NS  again  superior,  and  all  groups  improved  substantially  across 
the  IS  trials.  The  ANOVA  showed  significant  effects  for  training 
condition  Cpc.Ol)  and  for  trials  ,(p<.001).  After  transfer  to  the 
WC  condition,  however,  these  differences  disappeared  and  there 
were  no  significant  effects. 

Time  Within  Combined  Tolerances  (TWCT) 

During  carrier  approaches,  pilots  are  taught  to  attend 
closely  to  three  major  dimensions  of  the  task:  control  of 
glideslope,  lineup  and  AOA.  Accordingly,  a  composite  measure  was 
developed  to  reflect  a  pilot's  ability  to  control  simultaneously 
these  three  components  of  the  task.  A  score  was  computed  for 
each  trial  that  indicates  the  percentage  of  time  from  h  mile  to 
the  ramp  during  which  the  pilot  was  simultaneously  within  toler¬ 
ances  for  glideslope,  lineup  and  AOA  error.  Tolerances  were 
defined  in  terms  of  acceptable  deviations,  i.e.,  deviations 
which,  iri  the  LSO's  judgment,  would  be  considered  within  safe 
limits  and  which  normally  would  not  require  an  LSO  call  to  the 
pilot.  Tolerance  levels  are  summarized  in  Table  2. 

Results  for  the  TWCT  score  are  presented  in  Figure  6.  During 
training,  an  ANOVA  again  showed  large  differences  between  groups 
(p< . 00S)  as  well  as  a  large  learning  effect  (pc.OOl).  In  the 
testing  phase,  although  Group  NC  appears  somewhat  lower  than  the 
other  two  groups,  there  were  no  statistically  reliable  differences 

Individual  Components 

The  three  components  of  the  TWCT  were  also  examined  in¬ 
dividually,  to  see  whether  the  results  were  more  or  less  con¬ 
sistent  across  them.  Table  7  presents  a  comparison  between  the 
three  components  and  the  TWCT  (complete  ANOVA  tables  are  in 
Appendix  A) .  Averages  for  the  three  training  groups  are  shown 
and  the  probability  levels  for  all  significant  effects  are 
presented  along  with  the  nz  values  for  those  effects  (Eta  squared 
represents  the  proportion  of  the  total  variability  in  the  data 
that  is  accounted  for  by  a  particular  effect).  It  may  be  seen 
that  the  three  component  scores  present  a  remarkably  consistent 
picture:  during  training,  Group  NS  performed  best  and  (except 


TRAIN  TEST 

TRIALS 

Figure  5.  ISO  Grade  for  Blocks  of  Three  Trials. 

30 


,  MW»  e<\ 


TABLE  7.  TRAINING  GROUP  AVERAGES,  PROBABILITY 
LEVELS  OF  SIGNIFICANT  EFFECTS,  AND 
n2  VALUES,  FOR  PERCENTAGE  TIME  WITHIN 
TOLERANCE  SCORES  \h  MILE  TO  RAMP) . 


Glideslope  Lineup 


Angle  of  Combined 

Attack  (TWCT) 


Training  Trials  (1-15) 


Trng.  Cond.  Averages 


wc 

49.76 

61.30 

71.44 

26.34 

NC 

36.19 

32.95 

72.96 

10.60 

NS 

59.17 

69.65 

83.09 

39.33 

Trng.  Cond.  Main  Effects 

Probability  Level 

<.091 

<.001 

.  <.05 

<.005 

2 

n 

.1  2 

.23 

.05 

.19 

Trials  Main  Effects 

Probability  Level 

<.001 

<.001 

<.0S 

<.001 

2 

n 

.17 

.08 

.07 

.13 

Testing  Trials  (16-30) 

Trng.  Cond.  Averages 

■ 

WC 

70.67 

73.90 

81.76 

46.40 

NC 

60.62 

61.44 

81.92 

34.55 

NS 

67.61 

71.31 

83.17, 

43.42 

Trng.  Cond.  Main  Effects 

Probability  Level 

N.S. 

'  N.S. 

N.S. 

N.S. 

n2 

.03 

.05 

.00 

.04 

Trials  Main  Effects 

, 

Probability  Level 

N.S. 

N.S. 

N.S. 

N.S. 

n2 

.06 

.02 

.03 

.03 

N.S.  -  Not  significant  (i.e.,  p>.05) 
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lot  AOA )  ,  (I roup  NC  performed  poorest;  during  transfer  there  were 
no  significant  differences  whatever.  By  comparing  n2  values 
during  training,  it  is  evident  that  differences  between  training 
conditions  were  greatest  for  lineup  performance.  In  contrast, 
the  greatest  amount  of  improvement  across  trials  occurred  with 
glideslope  control. 

Performance  Score  Relationships 

Relationships  among  the  several  measures  discussed  thus  far 
were  examined.  Correlations  between  the  LPS,  the  LSO  grade,  and 
the  TWCT  were  computed  and  are  presented  in  Table  8.  Correlations 
are  shown  (a)  for  all  trials  (N=630) ,  (b)  for  all  trials  except 
ramp  strikes  (N=564),  and  (c)  for  all  trials  except  ramp  strikes 
and  waveoffs  (N=398). 

It  should  be  noted  that  the  correlations  change  in. a 
predictable  way  across  the  three  sets  of  data.  Consider  first 
the  LPS-LSO  correlations.  Since  both  measures  were  assigned  a 
value  of  0  for  ramp  strikes,  the  removal  of  those  trials  should 
result  in  a  lower  correlation  coefficient.  Additionally,  as 
waveoffs  were  always  scored  1.0  for  the  LPS  and  usually  were 
Scored  1.0  by  the  LSO,  a  further  reduction  in  the  correlation 
should  result  upon  elimination  of  these  trials. 

For  the  TWCT-LPS  and  the  TWCT-LSO  correlations  the  situation 
is  different.  On  those  trials  resulting  in  a  ramp  strike,  the 
pilot  typically  flew  a  reasonably  good  approach  until  very  near 
the  ship  (otherwise  he  would  have  been  waved  off) .  When  he  did 
make  a  "fatal"  mistake,  it  was  too  late  for  the  LSO  to  do  any¬ 
thing  except  watch.  Therefore,  while  the  LPS  or  the  LSO  grades 
were  both  0  for  these  trials,  the  TWCT  would  be  expected  to  be 
relatively  high  but  variable  across  trials.  Therefore,  elimina¬ 
tion  of  ramp  strikes  would  be  expected  to  increase  these  corre¬ 
lations.  Waveoff  trials  are  another  matter.  Here,  approaches 
typically  had  a  poor  start  and  remained  pool  throughout  the 
flight;  hence,  TWCT  scores  were  uniformly  low.  Removal  of  those 
trials  would  therefore  tend  to  decrease  the  correlations  of  TWCT 
with  either , LPS  or  LSO  grades. 

Regardless  of  which  set  of  data  is  considered,  the  principal 
findings  shown  in  Table  8  are  consistent.  Both  objective  summary 
measures  considered  here  (LPS  and  TWCT)  correlate  quite  highly 
with  the  more  subjective  LSO  grades  which  reflect  the  real-world 
measure  of  performance  used  in  the  training  and  operational 
environments  of  the  fleet.  Furthermore,  the  correlation  be¬ 
tween  the  two  objective  scores  is  quite  low,  suggesting  that 
these  measures  reflect  different  aspects  of  the  tasks. 
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TABLE  8.  TABLE  OF  I.NTERCORRELATIONS  FOR  LSO  GRADE, 
LANDING  PERFORMANCE  SCORE  (LPS) ,  AND  THE 
TIME  WITHIN  COMBINED  TOLERANCES  (TWCT) 


(A) 

All  trials  (N=630) 

LSO 

LPS 

TWCT 

LSO 

1.00 

.74 

.49 

LPS 

TWCT 

1.00 

.27 

1.00 

(B) 

Ramp  strikes  eliminated 

(N=S64) 

LSO 

LPS 

TWCT 

LSO 

1.00 

.67 

.60 

LPS 

TWCT 

1.00 

.32 

1.00 

(C) 

Ramp  strikes  and  waveoffs  eliminated 

(N=398) 

LSO 

LPS 

TWCT 

LSO 

1.00 

.47 

.52 

LPS 

TWCT 

1.00 

1 

1 

.18 

1.00 

To  explore  further  the  relations  among  different  objective 
measures  of  final  approach  and  touchdown  performance,  and  their 
ability  to  predict  real-world  performance  scores,  a  stepwise 
linear  regression  analysis  was  performed.  In  this  analysis  the 
criterion  measure  was  LSO  grades  and  the  predictor  variables  were 
the  LPS  and  the  three  components  of  the  TWCT:  percent  time  within 
tolerances  for  glideslope  (GS) ,  lineup  (LU)  and  angle  of  attack 
(AOA)  from  H  mile  to  the  ramp.  This  analysis  was  based  on  the 
398  trials  resulting  in  touchdown  (bolter  or  wire  trap). 

Table  9  summarizes  this  regression  analysis.  Several  points 
should  be  noted.  First,  the  predictor  variables  are  shown  to 
have  a  low  correlation  with  eiach  other.  Second,  the  addition  of 
each  of  the  predictor  variables  examined  does  improve  the  multiple 
R  (from  .47  for  LPS  alone  to  .66  for  all  four).  Third,  even 
though  the  final  step  improved  the  multiple  correlation  very 
slightly,  each  variable  made  a  large,  statistically  significant 
contribution  to  the  final  prediction  equation. 
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TABLE  9.  RESULTS  OR  STEPWISE  LINEAR 
REGRESSION  ANALYSIS. 


(A)  Table  of  intercorrelations 


LSO  LPS  GS  LU  AOA 


LSO 

.  ■  —  -- 

1.00  .47  .45 

.31  .26 

LPS 

■1.00  .13 

.02  .06 

GS 

1.00 

.23  .32 

LU 

1.00,  .09 

AOA 

1.00 

(B)  Stepwise  addition  of  variables  to 

predict  LSO  grades 

Step 

Variable(s)  Included 

Multiple  R 

1 

LPS 

.47 

2 

LPS  +  GS 

.61 

3 

LPS  +  GS  +  LU 

_ 

.65 

4 

LPS  +  GS  +  LU  +  AOA 

.  66 

(C)  Full  : 

model  regression  summary 

■ 

Variable 

Mean  Square  df 

F 

Significance 

LPS 

203.83  1 

117.55 

<.001 

GS 

98.08  1 

56.55 

<•001  ■ 

LU 

,58.49  1 

33.73 

<.001 

AOA 

14.06  1 

8.11 

<.005 

Error 

1.73  393 

In  summary,  these  analyses  indicate  that  the  measures 
described  were  appropriate  to  the  carrier  landing  task.  The 
relevance  of  the  LSO  grades  stems  from  the  fact  that  they  were 
only  a  slight  modification  of  a  scoring  system  used  by  the  Navy 
for  many  years.  The  other  measures  examined  do  not  correlate 
highly  with  each  other,  which  shows  they  are  measuring  different 
aspects  of  performance.  But  they  all  appear  to  reflect  components 
of  the  task  that  are  relevant,  in  the  sense  that  they  all  contri¬ 
bute  significantly  to  the  prediction  of  LSO  grades.  Together 
they  indicate  that  the  LSO' s  evaluation  of  a  pass  is  based  partly 
on,  final  touchdown  performance  and  partly  on  the  pilot's  ability 
to  fly  within  prescribed  tolerances  fo  the  separate  dimensions 
of  control  of  glideslope,  lineup,  and  AOA.  The  relevance  of 


NAVTRAEQUIPCEN  IH- 3 1 9/AFHRL-TR- SO -10 


these  measures  is  further  supported  by  the  fact  that  they  have 
all  been  shown  to  be  similarly  affected  by  the  training  condi¬ 
tions,  and  all  have  shown  a  similar  learning  effect  across  trials 
during  the  training  phase  of  the  experiment. 

As  a  final  point,  it  is  worth  noting  the  similarity  between 
the  correlations  obtained  in  this  simulator  study  and  some  that 
have  been  reported  for  actual  carrier  landing  performance. 

Brictson,  Burger  and  Gallagher  (1972)  present  data  obtained  from 
65  inexperienced  F-4  pilots  during  day  and  night  carrier  qualifi¬ 
cation  trials.  Their  correlations  between  the  LPS  and  the  LSO's 
grades  (4-point  scale)  were  .50  at  night,  .33  during  the  day,  and 
.45  overall. 

PERFORMANCE  DURING  THE  TURN 

Beginning  at  the  180-degree  position,  scores  were  collected 
at  five  discrete  points  around  the  turn,  and  at  %-mile  intervals 
during  the  final  approach.  Data  representing  distance  from  the 
carrier  during  the  turn  and  altitude  above  sea  level  are  presented 
in  Tables  10  and  11  (Part  A) ;  Part  B  of  these  tables  presents 
centerline  and  glideslope  error  scores  for  the  final  approach 
segment.  The  distance  and  centerline  deviation  scores  are  also 
shown  graphically  in  Figures  7  and  8. 

Considering  first  the  training  scores  (Table  10  and  Figure  7) , 
the  effect  of  the  narrow  FOV  was  to  cause  pilots  in  Group  NC  to 
turn  more  tightly,  so  that  when  they  crossed,  the  center  of  the 
wake  (90-degree  position),  they  were,  on  average,  547  feet  closer 
to  the  carrier  than  were  the  Group  WC  pilots.  Altitude  scores 
show  no  consistent  differences  (for  both  means  and  standard 
deviations)  between  the  two  groups.  During  the  final  approach 
both  groups  flew  left  of  centerline,  with  Group  NC  slightly 
farther  to  the  left  and  substantially  more  variable.  Group  NS, 
in  comparison,  flew  much  closer  to  centerline.,  The  major  differ¬ 
ence  between  groups  for  glideslope  error  is  that  Group  NC  wqs 
considerably  more  variable  than  the  other  groups. 

During  the  testing  phase  (Table  11  and  Figure  8),  Group  NC 
continued  to  make  the  tightest  turns,  and  WC  the  widest.  It  is 
interesting  to  note  that  NC  pilots  were  the  least  variable  of 
the  three  groups.  During  the  final  approach,  the  three  groups 
are  very  similar  with  respect  to  both  centerline  and  glideslope 
scores . 

The  final  stages  of  training  were  also  compared  with  the 
initial  stages  of  transfer,  in  a  search  for  differences  that  might 
have  been  obscured  when  the  15-trial  averages  were  considered. 

Table  12  presents  averages  for  the  last  three  training  trials, 
and  Table  13  summarizes  the  first  three  test  trials.  While  most 
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of  the  relationships  are  similar  to  those  seen  for  the  entire 
data  set,  there  is  one  substantial  difference.  On  trials  13-15, 
Group  NC  made  a  tighter  turn  than Group  WC,  as  it  did  on  average 
during  all  the  acquisition  trials.  However,  on  the  first  three 
test  trials.  Group  NC  turned  much  more  widely  (increasing  their 
distance  from  the  carrier  at  the  90-degree  position  by  961  feet 
over  the  three  previous  trials).  Thus,  when  first  tested  with  the 
wide  FOV,  Group  NC  pilots  turned  more  widely  than  Group  WC,  which 
reverses  the  relationship  shown  for  the  entire  testing  phase. 


TABU;  10.  TRIALS  1-15  (TRAINING  PHASE).  GROUND  POSITION 

and  Altitudes  (in  feet)  during  turn  and  final 

APPROACH.  GROUP  MEANS  AND  STANDARD  DEVIATIONS. 


(A)  During  turn:  Radial  distance  from  carrier  and  altitude 
above  sea  level  . 


Position 


180  Distance 
Altitude 

157.5°  Dist. 
Altitude 

135°  Distance 
Altitude 

112.5°  Dist.' 
Altitude 

90°  Distance 
Altitude 


WC 

Mean  S.D. 

6172 

37 

'585 

32 

6516 

173 

552 

63 

6586 

'  441 

489 

69 

5954 

733 

432 

61 

4260 

988 

339 

59 

Mean 


6154 

591 

6456 

555 

6527 

486 

5795 

434 

3713 

322 


NS 

Mean  S.D. 


1129 

62 


(B)  During  final  approach:  Lineup  (LU)  deviation  to  L(-)  or  R(  +  ) 
of  centerline,  and  glideslope  (GS)  deviation  below  (-)  or 
above  (  +  )  glideslope. 


Range 


h  mile  LU 
GS 

k  mile  LU 
GS 

at  ramp  LU 
GS 


WC 

Mean  S.D. 


NC’ 

Mean 

S.D. 

_NS_ 

Mean 

S.D. 

-212 

230 

-  36 

113 

+  14 

45 

+  13 

35 

-35 

97 

0 

50 

+  5 

43 

+  6 

2  i 

-9 

62 

-2 

17 

+  21 

52 

+9 

20 

TABLE  11.  TRIALS  16-BO  (TESTING  PHASE).  GROUND  POSITION 
AND  ALTITUDES  (IN  FEET)  DURING  TURN  AND  FINAL 
APPROACH.  GROUP  MEANS  AND  STANDARD  DEVIATIONS. 


(A)  During  turn:  Radial  distance  from  carrier  and  altitude 
above  sea  level. 


Group 


Position 

,  W(T 

Mean 

- NT 

Mean 

S.D.  • 

[■891 

LS0°  Distance 

6161 

33 

6146 

30 

6163 

39 

Altitude 

582 

.  26 

588 

28 

572 

35 

137. S°  Dist. 

6s:o 

155 

6438 

119 

6462 

163 

'  Altitude 

56  3 

50 

544 

45 

528 

61 

153°  Distance 

6721 

422 

6494 

351 

6558 

423 

Altitude 

507 

59 

483 

50 

478 

48 

!l  1 2  .  5°  Dist . 

6168 

680 

S844 

577 

591 

605 

j  Altitude 

451 

53 

424 

49 

432 

43 

90°  Distance 

4452 

10S5 

4140 

815 

4288 

840 

Al t i tude 

368 

64 

337 

.42 

349 

48 

(3)  Dui ing  final  approach:  Lineup  (LU)  deviation  to  L(-)  or  R(  +  ) 
of  centerline,  ar.d  glideslopc  (GS)  deviation  below  (-)  or 
above  (♦)  glideslopc. 


Group - 


Range 

wc 

Mean 

S.D. 

- N<r 

Me  an 

S.D. 

■ana 

’i  mile  LIJ 

-120 

159 

'  -179 

162 

i 

-‘j 

VO 

171 

GS 

♦  3 

18 

♦5 

21 

♦  2 

23 

mile  LU 

-  11 

49 

♦6 

42 

-5 

36 

GS 

♦1 

11 

♦3  . 

14 

0 

12 

at  ramp  LU 

-4 

10 

- 1 

17 

-  3 

10 

GS 

♦2 

6 

♦3 

8 

♦1 

' 

6 

HARROW,  STRAIGHT 


TABLE  12.  TRIALS  13-15.  GROUND  POSITION  AND 
ALTITUDES  (IN  FEET)  DURING  TURN  AND 
FINAL  APPROACH.  GROUP  MEANS  AND 
STANDARD  DEVIATIONS. 


(A)  During  turn:  Radial  distance'  from  ca*rrier’  and  altitudes 
above  sea  level. 


Group 


Position 

EH 

■h 

- NS 

Mean  S.D. 

180°  Distance 

6174 

43 

6155 

37 

Altitude 

583 

36 

587 

19 

- 

157.5°  Dist. 

6509 

226 

6456 

136  . 

Altitude 

548 

43 

543 

33 

- 

135°  Distance 

6528 

482 

6499 

366 

• 

Altitude 

482 

56 

477 

39 

- 

112.5°  Dist. 

58  71 

729 

5712 

555 

Altitude 

439 

42 

424 

46 

-  '  - 

90°  Distance 

4294 

962 

3636 

728 

• 

Altitude 

362 

56 

331 

37 

**  ” 

(B)  During,  final  approach:  Lineup  (LU)  deviation  to  L(-)  or  R(  +  ) 
of  centerline,  and  glides  lope  (GS)  deviation  below  (-)  or 
above  (+)  glides  lope. 

Group 


EH 

NT 

Mean  - 

S.D. 

Mdan 

h  mile  LU 

-122 

194 

-256 

163 

-30 

87 

GS  ■ 

-  3 

22 

♦  27 

30 

+  8 

2.4 

V  mile  LU 

-3 

48 

+  8 

62 

0 

34 

GS 

♦  4 

8 

+  3 

18 

♦  1 

8 

at  ramp  LU 

-7 

11 

+  8 

26 

-2 

12 

GS 

♦  1 

6 

♦  6 

13 

♦2 

6 

TABLH  13.'  TRIALS  16-18.  GROUND  POSITION  AND  ALTITUDES 
(IN  PELT)  DURING  TURN  AND  FINAL  APPROACH. 
GROUP  MEANS  AND  STANDARD  DEVIATIONS. 


(A)  During  turn:  Radial  distance  from  carrier  and  altitudes 
above  sea  level. 


Group 


Position 

- wT 

Mean 

S.D. 

NC 

Mean 

S.D. 

NS 

Mean 

S.D. 

180°  Distance 

6172 

35 

6158 

35 

6181 

36 

Altitude 

585 

28 

581 

38 

564 

45 

157.5°  Dist. 

6535 

ISO 

6490 

147 

6509 

175 

Altitude 

560 

51 

537 

55 

512 

70 

135°  Distance 

6612 

417 

6639 

435 

6542 

452 

Altitude 

509 

64 

467 

59 

464 

57 

112.5°  Dist. 

5910 

690 

6099 

676 

5812 

656 

Altitude 

438 

46 

419 

58 

422 

47  , 

90°  Distance 

4040 

1153 

4597 

965 

4229 

880 

Altitude 

34! 

66 

352 

38 

338, 

49 

(B)  During  final  approach:  Lineup  ,(LU)  deviation  to  L(-)  or  R(+) 
of  centerline,  and  glideslope  (GS)  deviation  below  (-)  or 
above  (+)  glideslope. 


Group 


,WC 

• 

uc - ■ 

NS 

Range 

Mean 

S.D. 

Mean 

S.D. 

Mean 

S.D. 

'-i  mile  LU 

-185 

169 

-80 

173 

-126 

156 

GS 

+  6 

19 

♦  5 

32 

+  5 

27 

h  mile  LU 

-31 

64 

-2 

45 

-5 

45 

GS 

♦  1 

13 

♦  4 

15 

+  1 

13 

at  ramp  LU 

-8 

11 

-16 

17 

-4 

12 

GS 

♦  3 

7 

♦  6 

8 

+  2 

8 
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SECTION  IV 
DISCUSSION 


Despite  large  differences  during  training,  none  of  the 
three  conditions  of  acquisition  showed  a  clear  superiority  during 
the  testing  phase  of, the  experiment.  The  Landing  Performance 
Score,  the  measures  of  time  within  tolerance  during  the  approach, 
and  the  LSO's  grading  of  each  pass  all  indicated  that  the  NS 
group  performed  best  during  acquisition.  Nevertheless,  although 
pilots  in  this  group  received  no  training  on  the  circling  portion 
of  the  task,  they  were  immediately  able  to  perform  the  transfer 
task  as  well  as  the  groups  that  received  training  on  the  full 
task.  We  believe  this  was  because  the  most  difficult  skills  to 
learn  were  those  involving  the  control  of  glideslope  and  lineup 
during  the  final  approach  for  whichthe  NS  condition  presented 
the  best  conditions  for  practice.  The  initialization  position 
for  the  NS  pilots  allowed  them  to  get  close  to  the  centerline  while 
they  were  still  far  from  the  ship,  so  that  when  they  arrived  within 
3/4  to  one  mile  of  the  carrier  they  had  few  gross  errors  of  lineup 
to  correct.  This  in'  turn  permitted  them  more  time  to  establish  the 
correct  rate  of  descent,  thereby  reducing  glideslope  errors.  Our 
belief  is  that  poorer  performance  on  the  final  approach  under  the 
two  circling  approach  conditions  resulted  because  much  time  and 
effort  was  spent  recovering  from  errors  of  lateral  position  when 
pilots  rolled  out  of  the  turn.  Clearly,  approach  control  was 
poorest  for  the  NC  condition,  which  had  the  most  restricted 
visual  environment  with  which  to  negotiate  the  turn. 

Further  evidence  for  this  interpretation  comes  from  measures 
of  the  size  of  the  significant  effects.  While  differences  between 
conditions  of  acquisition  were  reflected  most  by  the  measure  of 
lineup  control  (23%  of  the  variance),  the  largest  changes  seen- 
across  trials  were  in  the  glideslope  score  (17%  of  the  variance). 
This  suggests  that  while  most  of  the  learning  during  the  fexperi- 
ment  involved  glideslope  control  the  variable  that  dominated 
performance  under  the  different  training  conditions  was  alignment 
with  the  landing  deck  at  the  start  of  the  final  approach.  If 
fewer  errors  of  lineup  had  to  be  corrected  along  the  glidepath,  • 
better  glideslope  and  AOA  control  were  then  possible.  Better 
landings  resulted,  which  were  reflected  by  the  higher  LPS  and  by 
the , LSO  grades . , 

Support  for  this  position  can  be  Seen  in  the  measurements  of 
the  position  of  the  aircraft  during  the  turn.  During  acquisition 
the  NC  group  had  a  tendency  to  make  tighter  turns  than  the  WC 
group;  this  trend  continued  during  the  testing  phase  of  the 
experiment.  The  tighter  turn  could  have  been  simply  a  consequence 
of  greater  reliance  on  instruments,  or  it  may  have  been  made  in 
order  to  obtain  a  visual  image  of  the  carrier  earlier  than  would 
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otherwise  have  been  possible.  In  either  case  problems  encountered 
in  having  less  time  on  final  approach  to  be  correctly  aligned 
with  the  carrier  could  have  depressed  this  group's  final  approach 
performance . 

A  last  point  to  note  from  the  turn  data  is  that,  when  pilots 
in  the  NC  group  were  switched  to  the  wide  FOV  test  condition, 
they  initially  made  much  wider  turns  than  before.  They  were  almost 
1000  feet  farther  from  the  carrier  at  the  90°  radial  on  the  first 
three  transfer  trials  than  during  the  last  three  acquisition  trials 
This  difference  was  not  maintained,  as  their  average  distance  at 
this  position  across  Trials  16-30  was  less  than  that  of  the  WC  . 
group.  This  suggests  that  when  first  presented  the  wide  FOV 
image,  NC  pilots  may  have  initially  depended  almost  exclusively 
on  the  visual  display  for  the  turn.  They  later  may  have  reverted 
to  a  greater  use  of  instruments,  making  the  tighter  turns  that 
were  more  characteristic  of  their  acquisition  performance. 

It  should  be  emphasized  that  when  the  three  groups  were 
presented  the  same  task*  except  for  the  tendency  to  make  different 
turns  just  mentioned,  their  performance  was  virtually  equivalent. 
This  suggests  that,  for  the  carrier  landing  task,  there  are  no 
clear  training  advantages  of  a  wide  angle  visual  display.  In 
addition,  there  seems  to  be  no  reason  to  try  to  train  the  circling 
phase  of  carrier  approaches  using  narrow  angle  display  systems  - 
indeed  there  is  some  evidence  that  inappropriate  habits  can  be 
taught.  The  circling  phase  of  a  carrier  approach  does  not  appear 
difficult  to  learn  and  any  training  effort  in  a  simulator  is 
probably  best  spent  on  teaching  glideslope  and  lineup  control 
during  the  final  approach. 

Several  factors  should.be  considered  when  evaluating  the 
results  of  the  study.  The  subjects  were  proficient  Air  Force 
instructor  pilots  with  a  considerable  amount  of  flying  experience. 
Our  reason  for  choosing  them  was  that  we  wanted  subjects  who 
already  knew  how  to  fly  well,  but  who  knew  nothing  about  the 
procedures  and  techniques  of  landing  on  carriers.  Since  only  a 
limited  amount  of  simulator  time  was  available  for  this  study, 
we  did  not  want  to  spend  any  of  that  time  teaching  them  more 
basic  flying  skills.  One  consequence  of  this  decision  was  that 
some  well-learned  flying  techniques  interfered  with  the  learning 
of  this  task.  One  such  technique  is  flaring  just  prior  to 
touchdown,  which  is  not  done  when  landing  on  aircraft  carriers. 
Additionally,  Air  Force  pilots  do  not  normally  fly  constant  A0A 
approaches  and  therefore  do  hot  use  throttles  as  the  primary  means 
of  controlling  small  changes  in  glideslope.  Throughout  the 
experiment  many  pilots  continued  to  have  difficulty  adjusting 
to  these  new  techniques  and  this  tended  to  depress  their  approach 
and  landing  scores. 
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It  should  also  be  noted  that  these  pilots  were  quite 
proficient  at  flying  on  instruments,  as  compared,  for  instance, 
with  undergraduate  Navy  pilots  entering  the  carrier  landing 
portion  of  the  flight  syllabus.  The  result  is  that  the  per¬ 
formance  of  Group  NC  during  training  (and  perhaps  during  transfer) 
may  have  been  somewhat  better  than  it  would  have  been  with  less 
experienced  pilots. 

A  final  point  to  be  considered  is  that  while  much  learning 
obviously  took  place  during  the  experiment,  most  pilots'  perfor¬ 
mance  at  the  end  of  the  2h  hours  of  simulator  time  had  not 
approached  operational  levels  of  proficiency.  Even  though  we 
believe  the  pilots  improved  as  much  as  would  be  expected  in  15 
training  flights,  given  the  conditions  of  the  experiment,  more 
lengthy  training  sessions  would  probably  have  improved  performance 
further.  An  actual  training  program  involving  the  use  of  a 
simulator  for  teaching  day  carrier  landings  would  undoubtedly 
involve  considerably  more  simulated  flights  than  was  possible  in 
this  experiment.  In  view  of  the  implications  of  this  work  for 
simulator  design,  it  may  be  prudent  to  determine  whether  the 
principal  results  of  this  study  will  replicate  under  conditions 
of  considerably  greater  training  time  and  with  less  skilled 
pilots  as  subjects. 
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APPENDIX  A 


ANALYSIS  OF  VARIANCE  SUMMARY  TABLES 


These  tables  report  the  analyses  of  variance  (.ANOVAs) 
for  a  variety  of  measures  (Type  I  design,  Lindquist,  1953). 
Probability  levels  are  indicated  for  those  F-ratios  significant 
at  p<.05  or  better;  n2  (the  proportion  of  the  total  sum  of 
squares  for  a  given  effect)  is  also  shown  for  all  significant 
effects. 


TABLE  A- 1 .  ANOVA  FOR  THE  LANDING  PERFORMANCE  SCORE. 
(A)  Trials  1-15  (Training  Phase) 


Sum  of  Mean 


Source 

Squares 

df 

Square 

F-ratio 

E 

ni 

Between  Ss 

171.20 

20 

Trng.  Cond. 

51.66 

2 

25.83 

3.89 

cn 

o 

V 

.05 

Efror  (b) 

119.54 

18 

6.64 

Within  Ss 

859.34 

294 

Trials 

94.68 

14 

6.76 

2.39 

<.005, 

.09 

Trials  x  Cond. 

55.56 

28 

1.98 

0.68 

N.S. 

.05 

Error  (w) 

709.10 

252 

,2.81 

TOTAL 

1,030.54 

314 

1 

•  I 

* 

(B)  Trials  1-16 

(Testing 

Phase) 

Sum  of 

Mean 

Source 

Squares 

df 

Square 

F-ratio 

E 

ni 

Between  Ss 

133.27 

20 

Trng.  Cond. 

12.51 

2 

6.26 

0.93 

N.S. 

.01 

Error  (b) 

120.76 

18 

6.71 

Within  Ss 

1,076.73 

294 

Trials 

49.39 

14 

3.53 

0.95 

N.S. 

.04 

Trials  x  Cond. 

94.21 

28 

3.36 

0.91 

N.S. 

.08 

Error  (w) 

933.13 

252 

3.70 

( 

TOTAL 

1,210.00 

314 
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TABLE  A- 2.  ANOVA  FOR  THE  LSO  GRADES. 


(A)  Trials  1-15  (Training  Phase) 


Sum  of 

■ 

Mean 

Source 

Squares 

df 

Square 

F-ratio 

P 

n2 

Between  Ss 

537.59 

20 

Trng.  Cond. 

219.70 

2 

109.85 

6.22 

<0.01 

.13 

Error  (b) 

317.89 

18 

17.66 

Within  Ss 

1,214.40 

294 

Trials 

271.99 

14 

19.43 

5.55 

<0.001 

.16 

Trials  x  Cond. 

59.44 

28 

2.12 

0.61 

N.S. 

.03 

Error  (w) 

882.97 

252 

3.50 

TOTAL 

1,751.99 

314 

(B)  Trials  1-16  (Testing  Phase) 


Sum  of 

Mean 

Source 

Squares 

df 

Square 

F-ratio 

E 

.  ni 

Between  Ss 

313.13 

20 

Trng.  Cond. 

15.47 

2 

7.74 

0.47 

N.S. 

.01 

Error  (b) 

297.66 

18 

16.54 

Within  Ss 

1,582.53 

294 

Trials 

64.71 

14 

4.62 

0.83 

N.S. 

.03 

Trials  x  Cond. 

119.05 

28 

.  4.25 

0.77 

N.S. 

.  .06 

Error  (w) 

1,398.77 

252 

5.55 

TOTAL 

1,895.66 

314 

■x  •  r 


TABLE  A- 3.  ANOVA  FOR  THE  TIME  WITHIN 
COMBINED  TOLERANCES  (TWCT) 

(A)  Trials  1-15  (Training  Phase) 


Sum  of 

Mean 

Source 

Squares 

df 

Square 

F-ratio 

£ 

al 

Between  Ss 

85,899.07 

20 

Trng.  Cond. 

43,476.41 

2 

.21,738.21 

9.23 

<0.005 

.19 

Error  (b) 

42,422.66 

18 

2,356.81 

Within  Ss 

148,246.38 

294 

Trials 

31,517.14 

14 

2,251.22 

5.56 

<0.001 

.13 

Trials  x  Cond. 

14,550.49 

28 

519.66 

1.28 

N.S. 

.06 

Error  (w) 

102,178.75 

252 

405.47 

TOTAL 

234,145.87 

314 

(B)  Trials  1- 

16  (Testing 

Phase) 

Sum  of 

Mean 

Source 

Squares 

df 

Square 

F-ratio 

£. 

ni 

Between  Ss 

69,752.82 

20 

• 

Trng .  Cond. 

7,975.44 

2 

3,987.72 

1.16 

N.S. 

.04 

Error  (b) 

61,777.38 

18  ■ 

3,432.08 

Within  Ss 

134,927.32 

294 

Trials 

7,045.86 

,  14 

503.28 

1.10 

n.s; 

.03 

Trls.  x  Cond 

.  12,112.56 

28 

432.59 

0.94 

N.S. 

.06 

Error  (w) 

115,768.90 

252 

459.40 

TOTAL  204,680.14  314 


TABLH  A- 4.  ANOVA  FOR  CL  I 


(A)  Trials  1-15  (Training  Phase) 

Sum  of 


Source 

Squares 

df 

Between  Ss 

51,950.93 

20 

Trng.  Cond. 

28,009.53 

2 

Error  (b) 

23.941.40 

18 

Within  Ss 

187,356.27 

294 

Trials 

41,161.90 

14 

Trials  x  Cond 

.  20,358.12 

28 

Error  (w) 

125,836.25 

252 

TOTAL 

239,307.20 

314 

(B)  Trials  1-16  (Testing  Phase) 


Sum  of 

Source  Squares  df 


Between  Ss  41,056.08  20 

Trng.  Cond.  5,577.65  2 

Error  (b)  35,478.43  18 

Within  Ss  122,359.40  294 

Trials  9,531.37  14 

Trials  x  Cond.  10,600.75  28 

Error  (w)  102,227.28  252 

TOTAL  163,415.48  314 
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TIME  WITHIN  TOLERANCE. 


Mean 

Square  F-^atio  £ 


14,004.76  10.53  <0.001  .12 

1,330.08 


2,940.14  5.89  <0.001  .17 

727.08  1.46  N.S.  .09 

499.35 


Mean 

Square  F-ratio  £ 


2,788.83  1.41  N.S.  .03 

1,971.02 


680.81  1.68  N.S.  .06 
378.60  0.93  N.S.  .06 
405.67 


tabu:  as. 

A NOVA  1  OR 

1.1  M  HP 

TIME  WITHIN 

1  TOLERANCE . 

(A)  Trials  1-15 

(Training 

P It  a  S  ) 

Sum  of 

Mean 

Source 

Squares 

df 

Square 

F-ratio  p 

ni 

Between  Ss 

150,810.36 

20 

Trng.  Cond. 

77,726.30 

4. 

58 ,863.40 

13.18  <0.001 

.23 

Error  (b) 

53,083.56 

18 

2,949.09 

Within  Ss 

203,531.73 

294 

Trials 

26,482.92 

,14 

1,891.64 

3.12  <0.001 

.08 

Trials  x  Cond. 

24 ,4"9 . 37 

28 

874.26 

1.44  N.S. 

.07 

Error  (w) 

15  2, 569  .,44 

252 

605.43 

TOTAL 

334,342.09 

314 

(B)  Trials  1-16  (Testing  Phase) 


Sum  of 

Mean 

Source 

Squares 

df 

Square 

F-ratio 

R 

hi 

Between  Ss 

68,346.77 

20 

Trng.  Cond. 

9,104.35 

2 

4,552.18 

1.38 

N.S. 

.05 

Error  (b) 

59,242.42 

18 

3,291.25 

Within  Ss 

115,105.40 

294 

Trials 

4,019.61 

14 

287.12 

0.74 

N.S. 

.02 

Trials  x  Cond 

.  13,802.07 

28 

492.93 

1.28 

N.S. 

.08 

Error  (w) ■ 

97,283.72 

252 

386.05 

TOTAL 

183,452.17 

314 

S3 


TABLE  A- 6.  ANOVA  FOR  ANGLE  OF  ATTACK  TIME  WITHIN  TOLERANCE. 
(A)  Trials  1-15  (Training  Phase) 


Sum  of 

Mean 

Source 

Squares 

df 

Square 

F-ratio 

E 

ni 

3etween  Ss 

26,579.78 

20 

Trng.  Cond. 

8,426.37 

2 

4,213.19 

4.18 

<0.05 

.  05 

Error  (b) 

13,153.41 

,  18 

1,008.52 

Within  Ss 

140,636.07 

294 

. 

Trials 

12,456.01 

14 

889.72 

1.93 

<0.05 

.07 

Trials  x  Cond 

.  11,742.76 

28 

419.38 

0.91  , 

N.S. 

.07 

Error  (w) 

116,437.30 

252 

462.05 

TOTAL 

167,215.85 

314 

(B)  Trials  16- 

30  (Testing 

Phase) 

Sum  of 

Mean 

Source 

Squares 

df 

Square  F-ratio 

ni 

Between  Sr 

34,610.49 

20 

, 

Trng.  Cond. 

143.11 

2 

71.56  0.04 

N.S. 

.00 

Error  (b) 

34,467.38 

18 

1,914.85 

Within  Ss 

84,624.47 

294 

Trials 

4,166.59 

14 

297.61  1.04 

N.S. 

.03 

Tr’ais  x  Cond 

.  8,601.69 

28 

307.20  1.08 

N.S. 

.07 

Er  -or  (w) 

71 ,356.19 

252 

285.14 

TOTAL 

119,234.96 

314 

■ 
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1425  W.  49th  Street 
Norfolk,  VA  23508 

Prof  Ralph  E.  Elexman 
University  of  Illinois 
Institute  of  Aviation 
Terminal  Bldg  -  Willard  Airport 
Savoy,  IL  61874 

ATC/XPTD 

Randolph  AFB ,  TX  78148 

Deputy  Chief  of  Naval  Operations 
(MPT) 

OP-OIT 

Washington,  D.C.  20370. 

Headquarters,  US  Marine  Corps 
(Code  MPI-20) 

Washington,  D.C.  20380 

HQDA  (DAPE-MBR) 

Washington,  D.C.  20310 

US  Coast  Guard  (G-P-l/62) 

400  Seventh  Street,  SW 
Washington,  D.C.  20590 

OAD  (E  5  LS) 

ODDR5E 

Room  3D129,  Pentagon 
Washington,  D.C.  20301 

OASD  (MRA  5  L)/Training 
Room  3B922,  Pentagon 
Washington,  D.C.  20301 

ODASD(PM) 

Attn:  Major  W.  S.  Sellman 
Room  3B930,  Pentagon 
Washington,  D.C.  20301 

HQ  AFSC/DLS 
Andrews  AFB 

Washington,  D.C.  20334 
AMD/RDU 

Brooks  AFB,  TX  78235 


HQ  USAF/DPXHMM 
Washington,  D.C. 


20330 


HQ  USAF/MPCDW 
Bolling  AFB,  Bldg  626 
Washington,  D.C.  20332 


HQ  USAF/MPPT 
Washington,  D.C. 


20330 


HQ  USAF/SAMI 

Room  BD936,  The  Pentagon 
Washington,  D.C.  20330 

ATC/XPTIA 

Randolph  AFB,  TX  78148 

DCT/TTGH 
Stop  62 

Chanute  AFB,  IL  61868 

Keeslcr/TTGHX 
Keesler  AFB,  MS  39534 

LTTC/TTS 

Lowry  AFB,  CO  80230 

STTC/TTGHR 
Stop  32 

Sheppard  AFB,  TX  76311 


SAF/ALR 

Washington,  D.C. 


20330 


AFMPC/MPCYPR 
Randolph  AFB,  TX  78148 

AFOSR/NL  (Dr.  A.  R.  Fregley) 
Bolling  AFB 

Washington,  D.C.  20332 

Center  for  Naval  Analyses 
Attn:  Dr.  R.  F.  Lockman 
2000  N.  Beauregard  Street 
Alexandria,  VA  22311 

Commander 
HQ,  TRADOC 
Attn:  ATTNG-PA 
Ft  Monroe,  VA  23651 
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CDR,  Navy  Recruiting  Command  1  AFHRL  Technology  Office  1 


(Code  N22) 

4015  Wilson  Blvd. 

Arlington,  VA  22205 

Dot  -1,  HQ  MAC  1 

Wright -Patterson  AFB,  OH  45433 

Director  1 

Training  Analysis  $  Evaluation 
Group 

Department  of  the  Navy 
Orlando,  FL  32813 

DMDC  (DPMYL)  1 

550  Camino  El  Estero 
Monterey,  CA  93940 

MEPCOM/MHPCT  2 

Ft  Sheridan,  IL  60037 

MI  ISA  Branch  Office  1 

Bldg  S-237 

Naval  Air  Station  Memphis 
Mi  1  lington ,  IN  38054 

PER  I  - OU  1 

US  Army  Institute  for  the 

Behavioral  6  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Personnel  6  Training  Research  3 

Programs 

Office  of  Naval  Research  (Code  458) 
Psychological  Sciences  Division 
800  N.  Quincy  Street 
Arlington,  VA  22217 

US  Army  Institute  of  Administrat ionl 

Attn:  ATZI -DCO-EA 

Ft  Benjamin  Harrison,  IN  46216 

IJS  Army  Research  Institute  for  1 

the  Behavioral  and  Social 
Sciences 
Attn:  PERI -OB 

P.O.  Box  2086 
Ft  Bcnning,  GA  31905 

1550  ATTW  (MAC)  (DOTF.E)  Stop  #64  1 

K i rt land  AFB,  NM  87117 


Attn:  MAJ  Duncan  L.  Dieterly 

NASA-Ames  Research  Center 
MS  239-2 

Moffett  Field,  CA  94035 

AFSC  Liaison  Uff ice  1 

NASA-Ames  Research  Center 
Moffett  Field,  CA  94035 

Commanding  Officer  1 

Attn:  ESD/ESS 

Marine  Corps  Communicat ion  - 
Electronics  Schools 
Marine  Corps  Base 
Twentynine  Palms,  CA  92278 

National  Defense  University  1 

Research  Directorate 
Ft  McNair,  D.C.'  20319 

Dr.  Michael  Letsky  (OP  102B/WEM)  1 

R5D  Studies  Branch  (Manpower, 
Personnel  and  Training) 

Navy  Department 
Washington,  D.C.  20350 

Dr.  H.  P.  VanCott  1 

National  Bureau  of  Standards 
A-375  Metrology  Bldg 
Washington;  D.C.  20234 

Naval  Civilian  Personnel  Command  1 

Attn:  James  S.  Herndon 

Southern  Field  Division 
Norfolk,  VA  23511 

COL  A.  J.  Affleck  1 

Director  of  Psychology  -  Navy 
Department  of  Defense  (Navy  Office) 
Camberra  ACT  2600 
AUSTRALIA 

Mr.  J.  Anderson  1 

Head  of  Personnel  Psychological 
Division 
c/o  RAE,  APRE 

Farnborough,  Hants,  ENGLAND 

LT  COL  Joseph  Birt 
Aerospace  Medical  Research 
Laboratories/HE 

Wright -Patterson  AFB,  OH  45433 
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Dr.  Ralph  R.  Canter  1 

US  Army  Research  Institute 

Field  Unit 

P.O.  Box  16117 

Fort  Harrison,  IN  46216 

Mr.  K.  Corkindale  1 

AD/ SAG (A) 3 
Main  Building 

Whitehall,  London  SWIA  2HB 
ENGLAND 

MAJ  Charles  A.  U.  Cotton  1 

Canadian  Forces  Personnel 
Applied  Research  Unit 
1107  Avenue  Road 
Toronto,  Ontario  M5N  2E4 
CANADA 

Dr.  Ralph  Dusek  2 

US  Army  Research  Institute 

for  the  Behavioral  and  Social 
Sciences 

5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Mr.  E.  Elliott  1 

SP  (N) 

Archway  South,  Old  Admiralty  Bldg 

Spring  Gardens 

London  SWLA  2BE ,  ENGLAND 

Dr.  John  Ford  1 

Naval  Personnel  Research  and 
Development  Center 
San  Diego,  CA  92152 

Dr.  K.  Gardner  1 

Head  of  APU 

Admiralty  Marine  Technology 
Establishment 
Queens  Road 

Tcddington,  Middlesex,  UK 

USAFSAM/VN  (Dr.  Bryce  Hartman)  1 
Brooks  AFB ,  TX  78235 

Mr.  D.  Ilopkin  1 

RAF  Institute  of  Aviation  and 
Medicine 

Fdrnborough,  Hampshire 
ENGLAND 


Mr.  Les  Innes  1 

Behavioral  Sciences  Division 
Defense  and  Civil  Institute 
of  Environmental  Medicine 
P.O.  Box  2000 
Downsview,  Ontario  M3M, 

CANADA 

Mr.  J.  James  1 

Research  Branch 
HQ  Support  Command 
RAF  Upwood 

Huntingdon,  Cambridgeshire  PE17  1PJ 
ENGLAND 

Dr.  Ed  Johnson  1 

US  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

MAJ  E.  J.  Lewis  1 

Productivity  Development  Division 
Department  of  Productivity 
Canberra  ACT  2600 
AUSTRALIA 

Librarian  1 

RAN  Research  Laboratory 

P.O.  Box  706 

Dar 1 inghurst ,  NSW  2010 

AUSTRALIA 

Dr.  John  E.  Mayhood  1 

Director  General,  Personnel 
Research  §  Development 
National  Defense  Headquarters 
Ottawa,  Ontario  K1A  0K2 
CANADA 

COL  A.  G.  Owens  1 

D.  Psych -A 

Department  of  Defense 
Canberra  ACT  2600 
AUSTRALIA  , 

Dr.  D.  G.  Pearce  1 

Behavioral  Science  Division,  DCIEM 
P.O.  Box  2000 

Downsview,  Ontario  M3M  3B9 
CANADA 
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Dr.  M.  Radomski  2  IPC  Science  and  Technology  Press  1 

Associate  Chief,  Defense  and  Limited 


Civil  Institute  of  Environmental 
Medicine 
P.0.  Box  2000 

Downsview,  Ontario  M3M  3B9 
CANADA 

Dr.  L.  A.  Ryder  1 

Directorate  of  Psychology  -  Air 
Force 

DEFAIR  -  Russell  Offices 
Canberra  A.C.T.  2600 
AUSTRALIA 

Dr.  H.  Wallace  Sinaiko  1 

Smithsonian  Institution 
Manpower  Research 
801  N.  Pitt  Street 
Alexandria,  VA  22314 

Dr.  K.  N.  Ackles  4 

Defense  Research  and  Development 
Canadian  Defense  Liaison  Staff 
2450  Massachusetts  Avenue,  NW 
Washington,  D.C.  20008 

Mr.  K.  W.  Tilley  1 

ACS (P)  (RAF) 

Main  Building 

Whitehall,  London  SWIA  2HB 
ENGLAND 

Dr.  Martin  Tolcott  1 

Office  of  Naval  Research 
800  N.  Quincy  Street 
Department  of  the  Navy 
Arlington,  VA  22217 

Dr.  Martin  Wiskoff  1 

Navy  Personnel  Research  and 
Development  Center 
San  Diego,  CA  92151 

Dr.  Russell  Brown  1 

Defense  and  Civil  Institute  of 
Environmental  Medicine 
P.O.  Box  2000 

Downsview,  Ontario  M3M  3B9 
CANADA 


Westbury  House 
Bury  Street 

Guildford,  Surrey,  GU2  5AW 
ENGLAND 

Commanding  Officer  1 

Canadian  Forces  Personnel  Applied 
Research  Unit 
Suite  600 
4900  Yonge  Street 
Willowdale,  Ontario  MZN  6B7 
CANADA 

LT  COL  Dennis  J.  Armstrong  2 

1  Psych  Research  Unit 

Department  of  Defense  (Army  Office) 

Campbell  Park  Offices 

CANBERRA  ACT  2600 

AUSTRALIA 

The  Air  Attache  (S3B)  1 

Embassy  of  Australia 
1601  Massachusetts  Avenue,  NW 
Washington,  D.C.  20036 

Dr.  J.  Huddleston  1 

Head  of  Personnel  Psychology 
Army  Personnel  Research  Establishment 
c/o  RAE,  Farnborough 
Hants,  ENGLAND 

The  Naval  Attache  .  1 

Embassy  of  Australia 
1601  Massachusetts  Avenue,  NW 
Washington,  D.C.  20036 

Dr.  Jesse  Orlansky  1 

Science  and  Technology  Division 
Institute  for  Defense  Analyses 
400  Army-Navy  Drive 
Arlington,  VA  22202 

HumRRO/Western  Division/Carmel  1 

Office  . 

27857  Berwick  Drive 
Carmel,  CA  93923 

Seville  Research  Corporation  1 

Suite  400 
Plaza  Building 
Pensacola,  FL  32505 
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Technical  Library 
Naval  Training  Equipment  Center 
Orlando,  FL  32813 

4444th  OPS  SQDN  (OTD) 

Luke  AFB ,  AZ  85309 

TAC/DOOS 

Langley  AFB,  VA  23665 
34  TATG/TTDI 

Little  Rock  AFB,  AR  72076 

National  Aviation  Facilities 
Experimental  Center 
Library 

Atlantic  City,  NJ  08405 

Dr.  Donald  W.  Connolly 
Research  Psychologist 
Federal  Aviation  Administration 
FAA  NAFEC  ANA-230  Bldg  3 
Atlantic  City,  NJ  08405 

Commanding  Officer 
Air  Force  Office  of  Scientific 
Research 

Technical  Library 
Washington,  D.C.  20025 

Technical  Library  1 

DDR5E  ' 

Room  30122 

Washington,  D.C.  20301 

OUSDR5E  (R5AT)  (E§LS)  1 

CDR  Paul  R.  Chatelier 
Washington,  D.C.  20301 

Commander  1 

Naval  Air  Development  Center 
Attn:  Technical  Library 
Warminster,  PA  18974 

Deputy  Chief  of  Naval  Operations  1 
(MPT) 

OP- 102 

Attn:  M.  K.  Malehorn 
Arlington  Annex 
Washington,  D.C.  20350 


1  Assistant  Secretary  of  the  Navy 
Research,  Engineering  8  Systems 
Washington,  D.C.  20350 

Office  of  Deputy  Chief  of  Naval 
Operations 

Manpower,  Personnel  and  Training 
(OP-01) 

Washington,  D.C.  20350 

Chief  of  Naval  Operations 
OP-987H 

Attn:  Dr.  R.  G.  Smith 
Washington,  D.C.  20350 

Chief  of  Naval  Operations 
OP- 5960 

Washington,  D.C.  20350 

Chief  of  Naval  Operations 
OP-593B 

Washington,  D.C.  20350 

Chief  of  Naval  Material 
MAT  08D2 
CP5 ,  Room  678 

Attn:  Arnold  I.  Rubinstein 
Washington,  D.C.  20360 

Commander 

Naval  Air  Systems  Command 
Technical  Library 
AIR-950D 

Washington,  D.C.  20361 
Commander 

Naval  Air  Systems  Command 
AIR  340F 

Washington,  D.C.  20361 
Commander 

Naval  Air  Systems  Command 
AIR  4135B 

Attn:  LCDR  J.  H.  Ashburn 
Washington,  D.C.  20361 

Naval  Research  Laboratory 
Attn:  Library 
Washington,  D.C.  20375 
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HQ  Marine  Corps  1 

Code  APC 

Attn:  LTC  J.  W.  Biermas 
Washington,  D.C.  20380 

Scientific  Advisor  1 

Headquarters  US  Marine  Corps 
Washington,  D.C.  20380 

Scientific  Technical  Information  1 
Office 
NASA 

Washington,  D.C.  20546 

Federal  Aviation  Administration  1 
Technical  Library 
Bureau  Research  and  Development 
Washington,  D.C.  20590 

Commander  .  1 

Naval  Air  Test  Center 
CT  176 

Patuxent  River,  MI  20670 

Dr.  J.  D.  Fletcher  1 

Defense  Adv.  Research  Projects 
Agency  (CTO) 

1400  Wilson  Boulevard 
Arlington,  VA  22209 

Commanding  Officer  1 

Naval  Education  Training  Program 
,  and  Development  Center 
Attn:  Technical  Library 
Pensacola,  FL  32509 

Chief  of  Naval  Education  and  1 

Training 
Code  01A 

Pensacola,  FL  32509 

Commanding  Officer  1 

Naval  Aerospace  Medical  Research 
Laboratory 
Code  L5 

Department  of  Psychology 
Pensacola,  FL  32512 

Chief  1. 

ARI  Field  Unit 
P.O.  Box  476 
Ft  Rucker,  AL  36362 
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Chief  of  Naval  Air  Training  1 

Attn:  Code  N2 

NAS 

Corpus  Christi,  TX  78419 

Chief  of  Naval  Education  and  1 

Training  Liaison  Office 
Human  Resource  Laboratory 
Flying  Training  Division 
Williams  AFB,  AZ  85224 

Commander  1 

Pacific  Missile  Test  Center 
Point  Mugu,  CA  93042 

Commander  1 

Naval  Weapons  Center 
Human  Factors  Branch  (Code  3194) 
;.ttn:  Mi .  Ronald  A.  Erickson 
China  Lake,  CA  93555 

CDR  Robert  S.  Kennedy  1 

Officer  in  Charge 
Naval  Aerospace  Medical  Research 
Laboratory 
Box  29407 

New  Orleans,  LA  70189 

CAPT  James  Goodson  1 

Code  L- 53 

Naval  Aerospace  Medical  Research 
Laboratory 

Pensacola,  FL  32512 


Mr.  James  Basinger  1 

ASD/YWE 

Wright  Patterson  AFB,  OH  45433 

Mr.  Don  Gum  1 

AFHRL/OTT 

Wright  Patterson  AFB,  OH  45433 

Mr.  Eric  Monroe  1 

AFHRL/OTR 

Williams  AFB,  AZ  85224 

Mr.  Thomas  Longridge  1 

AFHRL/OTR 

Williams  AFB,  AZ  85224 

Dr.  Kenneth  Boff  i 

AFHRL/LR 

Wright  Patterson  AFB,  OH  45433 
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Mr.  Brian  Goldiez  1 

PM  TRADE 

Attn:  DRCPM-PND-RE 
Naval  Training  Center 
Orlando,  FL  32813 


Mr.  Robert  Wright  1 

Aeromechanics  Lab  (USAAVRADCOM) 
Ames  Research  Center,  MS  239-2 
Moffett  Field,  CA  94035 

Dr.  David  C.  Nagel  1 

LM-239-3 

NASA  Ames  Research  Center 
Moffett  Field,  CA  94035 

Mr.  Will  Bickley  1 

USARI  Field  Unit 

P.O.  Box  476 

Fort  Rucker,  AL  36362 

Mr.  James  L.  Copeland  1 

NASA  Langley  Research  Center 
MS  125-B 

Hampton,  VA  23365 

AFHRL/OTLN  20 

Williams  AFB ,  AZ  85224 

AFHRL/-TSZ  38 

Brooks  AFB,  TX  78235 
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